00000001:02000400:2.0F:1787692170.297055:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_hostid 00000001:02000400:2.0:1787692187.167082:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1787692188.789298:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 851 MB/s 00000001:01000000:3.0:1787692189.038959:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1047 MB/s 00000001:01000000:2.0:1787692189.289018:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6159 MB/s 00000020:02000000:3.0:1787692189.789057:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_80_g4b309f5 00000400:02000000:1.0F:1787692190.564021:0:3288:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.127@tcp [8/256/0/180] 00008000:02000000:1.0:1787692194.014956:0:3438:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787692238.634604:0:5239:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787692247.446174:0:5812:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787692247.446181:0:5812:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787692247.446324:0:5812:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000435c5f94 00000080:02000400:3.0:1787692247.446334:0:5812:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1787692247.459258:0:5812:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1787692247.459277:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787692247.460129:0:5812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009559f9c8) 00000020:00000080:0.0F:1787692247.462173:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787692247.527001:0:5812:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787692247.530077:0:5812:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1787692247.563560:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787692247.563677:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787692247.563704:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787692247.563759:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787692247.563789:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787692247.564789:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1787692247.564800:0:5812:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787692247.565102:0:5812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09ddfba 00000020:01000004:0.0:1787692247.565113:0:5812:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1787692247.565118:0:5812:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1787692247.565124:0:5812:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000435c5f94 from MGS 00000020:01000004:0.0:1787692247.565130:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1787692247.565152:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c150ec25) 00000020:00000080:0.0:1787692247.565165:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1787692247.565462:0:5812:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000435c5f94 from MGS, refs=2 00080000:01000000:0.0:1787692247.565468:0:5812:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787692247.565475:0:5812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09ddfc8 00000100:00100000:0.0:1787692247.565668:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1787692247.566123:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1787692247.566134:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787692247.567158:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787692247.567169:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787692247.569037:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787692247.569413:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787692247.569420:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787692247.570492:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787692247.570502:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787692247.571110:0:5812:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787692247.571119:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787692247.572165:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692247.572169:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692247.572171:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692247.572654:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692247.572657:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692247.572658:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692247.573799:0:5812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787692247.578724:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787692247.822989:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3243 MB/s 00000001:01000000:0.0:1787692248.072873:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3303 MB/s 00000001:01000000:3.0:1787692248.324000:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 619 MB/s 00000001:01000000:2.0:1787692248.575135:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 888 MB/s 00010000:00010000:3.0:1787692248.577007:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787692248.583588:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1787692248.595948:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787692248.596037:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787692248.596040:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787692248.598976:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787692248.600027:0:5812:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787692248.600087:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787692248.600680:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787692248.600717:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1787692248.601609:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787692248.601929:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1787692248.601937:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787692248.607068:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1787692248.609041:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787692248.609551:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787692248.609619:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787692248.610528:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787692248.610554:0:5812:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.127@tcp' 00000020:01000004:2.0:1787692248.610556:0:5812:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787692248.610663:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.127@tcp (typ=mgc) 00000020:00000080:2.0:1787692248.610685:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.127@tcp (00000000b1757109) 00000020:00000080:2.0:1787692248.610704:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:3.0:1787692248.611145:0:5827:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:2.0:1787692248.611179:0:5812:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000814f3879@MGC192.168.206.127@tcp: add connection 192.168.206.127@tcp at head 00010000:00010000:2.0:1787692248.611410:0:5812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.127@tcp-0 is initialized 00000040:01000000:2.0:1787692248.611418:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 1 is initialized 10000000:01000000:3.0:1787692248.613952:0:5828:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787692248.615073:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.127@tcp (uuid 74f850a3-c102-416a-ae3b-08438aa77de6) 00000020:00000080:2.0:1787692248.615115:0:5812:0:(genops.c:1385:class_connect()) connect: client 74f850a3-c102-416a-ae3b-08438aa77de6, cookie 0x5d8b8560a09ddfd6 00000100:00080000:2.0:1787692248.615133:0:5812:0:(import.c:510:import_select_connection()) MGC192.168.206.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787692248.615140:0:5812:0:(import.c:624:import_select_connection()) MGC192.168.206.127@tcp: import 00000000814f3879 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:2.0:1787692248.615206:0:5812:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004d588945 x1874531125821568/t0(0) o250->MGC192.168.206.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787692248.615230:0:5812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 74f850a3-c102-416a-ae3b-08438aa77de6->MGS 00000020:01000004:2.0:1787692248.615261:0:5812:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787692248.615267:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787692248.615283:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000b28b6e2) 00000020:00000080:2.0:1787692248.615297:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787692248.616593:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004d588945 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74f850a3-c102-416a-ae3b-08438aa77de6:3303:1874531125821568:0@lo:250: 00000100:00100000:3.0:1787692248.616751:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692248.616868:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125821568 00000100:00100000:3.0:1787692248.616878:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125821568 00000100:00100000:3.0:1787692248.616928:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787692248.616935:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abc513fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1874531125821568:12345-0@lo:250: 00010000:00080000:3.0:1787692248.616965:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 74f850a3-c102-416a-ae3b-08438aa77de6@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:3.0:1787692248.616997:0:5823:0:(genops.c:1385:class_connect()) connect: client 74f850a3-c102-416a-ae3b-08438aa77de6, cookie 0x5d8b8560a09ddfe4 00000100:00080000:3.0:1787692248.617177:0:5823:0:(import.c:65:import_set_state_nolock()) 000000002b8731da : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787692248.617669:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abc513fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+5:3303:x1874531125821568:12345-0@lo:250: Request processed in 731us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692248.617679:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787692248.618156:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787692248.618169:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.127@tcp: connect to target with instance 0 00000100:00080000:3.0:1787692248.618177:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787692248.618183:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787692248.618186:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000814f3879 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787692248.618189:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787692248.618199:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787692248.621204:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004d588945 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74f850a3-c102-416a-ae3b-08438aa77de6:3303:1874531125821568:0@lo:250: 00000100:00100000:1.0:1787692248.639640:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787692248.640022:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787692248.640031:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1787692248.641633:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1787692248.641646:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787692248.642433:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787692248.642442:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787692248.643404:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787692248.643614:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787692248.643619:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787692248.644589:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787692248.644600:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787692248.686654:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787692248.687022:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787692248.687030:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787692248.688447:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787692248.688459:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787692248.690425:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787692248.690916:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787692248.690924:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787692248.691776:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787692248.691785:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787692248.692463:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787692248.692698:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787692248.692711:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787692248.694679:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787692248.694692:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787692248.695426:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787692248.695616:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787692248.695621:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787692248.696443:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787692248.696454:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787692248.721371:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787692248.723579:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787692248.723589:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787692248.731221:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787692248.731246:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1787692248.732557:0:5812:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787692248.732570:0:5812:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787692248.737546:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787692248.737581:0:5812:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787692248.737588:0:5812:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787692248.737737:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787692248.737780:0:5812:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.127@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787692248.737785:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787692248.737787:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787692248.737788:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692248.737789:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692248.737790:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692248.737792:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692248.737793:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787692248.737795:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787692248.737796:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787692248.737797:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787692248.737799:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692248.737801:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787692248.737803:0:5812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787692248.737806:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787692248.737807:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787692248.737808:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692248.737809:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692248.737941:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692248.737942:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692248.737943:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787692248.737949:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787692248.737950:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787692248.737951:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787692248.737952:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692248.737953:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787692248.737996:0:5812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787692248.738018:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006292e276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125821696:0@lo:253: 00000100:00100000:3.0:1787692248.738112:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692248.738287:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042992312 going to sleep for 11 seconds 00000100:00100000:2.0:1787692248.738361:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125821696 00000100:00100000:2.0:1787692248.738371:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125821696 00000100:00100000:2.0:1787692248.738461:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787692248.738471:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070be4254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+5:5812:x1874531125821696:12345-0@lo:253: 20000000:01000000:2.0:1787692248.738524:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787692248.738527:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787692248.738946:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787692248.738995:0:5826:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1787692248.739381:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787692248.740397:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1787692248.740682:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787692248.740687:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1787692248.740695:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1787692248.740699:0:5826:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1787692248.740716:0:5826:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1787692248.741224:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787692248.741486:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1787692248.741502:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787692248.741556:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1787692248.741610:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1787692248.741652:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1787692248.741748:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1787692248.741758:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1787692248.742121:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1787692248.742198:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1787692248.742240:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1787692248.742248:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1787692248.742296:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1787692248.742360:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1787692248.742399:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787692248.742404:0:5826:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1787692248.742418:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787692248.742622:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787692248.742632:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787692248.742665:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787692248.742701:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787692248.742749:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787692248.742761:0:5826:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787692248.743029:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787692248.743039:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787692248.743082:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787692248.743118:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787692248.743232:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787692248.743244:0:5826:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787692248.743362:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787692248.743371:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787692248.743405:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787692248.743439:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787692248.743604:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787692248.743656:0:5826:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787692248.743664:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787692248.744261:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787692248.744595:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787692248.744622:0:5826:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.127@tcp for mdt 20000000:01000000:2.0:1787692248.744625:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.127@tcp (null) (null) (null) 00000040:00080000:2.0:1787692248.744659:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787692248.744674:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787692248.744708:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787692248.744715:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.127@tcp (null) (null) 00000040:00080000:2.0:1787692248.744775:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787692248.744787:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787692248.745031:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787692248.745075:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787692248.745217:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787692248.745221:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787692248.745225:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787692248.745238:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787692248.745241:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787692248.745270:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787692248.745272:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787692248.745681:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1787692248.746037:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1787692248.746078:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1787692248.746214:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1787692248.746229:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787692248.746232:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787692248.746682:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787692248.747019:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787692248.747058:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787692248.747091:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787692248.747103:0:5826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787692248.747106:0:5826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787692248.747110:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787692248.747113:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787692248.747119:0:5826:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787692248.747126:0:5826:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787692248.747577:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1787692248.747708:0:5826:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787692248.761436:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787692248.761494:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787692248.761572:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787692248.761595:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787692248.761616:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c25a56e7/0x5d8b8560a09ddfeb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692248.761632:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c25a56e7/0x5d8b8560a09ddfeb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692248.761641:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c25a56e7/0x5d8b8560a09ddfeb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692248.761647:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c25a56e7/0x5d8b8560a09ddfeb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692248.761652:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c25a56e7/0x5d8b8560a09ddfeb lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692248.761658:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c25a56e7/0x5d8b8560a09ddfeb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692248.761663:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c25a56e7 already unused, calling callback (00000000baa2c9ff) 00010000:00010000:3.0:1787692248.761667:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c25a56e7/0x5d8b8560a09ddfeb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692248.761683:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c25a56e7/0x5d8b8560a09ddfeb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692248.761695:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c25a56e7/0x5d8b8560a09ddfeb lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692248.761703:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c25a56e7/0x5d8b8560a09ddfeb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692248.761709:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c25a56e7/0x5d8b8560a09ddfeb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787692248.761726:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1787692249.041103:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070be4254 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+5:5812:x1874531125821696:12345-0@lo:253: Request processed in 302436us (302793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692249.041152:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787692249.041448:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006292e276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125821696:0@lo:253: 10000000:01000000:3.0:1787692249.041467:0:5812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787692249.041470:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787692249.041472:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787692249.041474:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692249.041475:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787692249.041476:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692249.041478:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692249.041479:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787692249.041481:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787692249.041483:0:5812:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787692249.041484:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692249.041486:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787692249.041515:0:5812:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000435c5f94 from lustre-MDT0000 10000000:01000000:3.0:1787692249.041548:0:5812:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787692249.041552:0:5812:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787692249.041557:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff92ec87fd3370 10000000:01000000:3.0:1787692249.041561:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787692249.041571:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92ec87fd3370 from 1 10000000:01000000:3.0:1787692249.041582:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787692249.041629:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 00000000c25a56e7/0x5d8b8560a09ddff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.041641:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 00000000c25a56e7/0x5d8b8560a09ddff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.041650:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 00000000c25a56e7/0x5d8b8560a09ddff2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692249.041670:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006292e276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125821824:0@lo:101: 00000100:00100000:3.0:1787692249.041719:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692249.041801:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f2ddb803 going to sleep for 11 seconds 00000100:00100000:1.0:1787692249.041985:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125821824 00000100:00100000:1.0:1787692249.041994:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125821824 00000100:00100000:1.0:1787692249.042144:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787692249.042155:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096c39778 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+5:5812:x1874531125821824:12345-0@lo:101: 00010000:00010000:1.0:1787692249.042169:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692249.042185:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab5108b8/0x5d8b8560a09ddff9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09ddff2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.042212:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab5108b8/0x5d8b8560a09ddff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09ddff2 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.042222:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab5108b8/0x5d8b8560a09ddff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09ddff2 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.042231:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab5108b8, rc 0) 00000100:00100000:1.0:1787692249.042293:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096c39778 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+6:5812:x1874531125821824:12345-0@lo:101: Request processed in 141us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692249.042309:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787692249.042347:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006292e276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125821824:0@lo:101: 00010000:00010000:2.0:1787692249.042363:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 00000000c25a56e7/0x5d8b8560a09ddff2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09ddff9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.042373:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 00000000c25a56e7/0x5d8b8560a09ddff2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09ddff9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692249.042428:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053e50eb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125821952:0@lo:501: 00000100:00100000:2.0:1787692249.042468:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692249.042510:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ea6d31d2 going to sleep for 11 seconds 00000100:00100000:1.0:1787692249.042599:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125821952 00000100:00100000:1.0:1787692249.042605:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125821952 00000100:00100000:1.0:1787692249.042639:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787692249.042646:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000062808382 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+6:5812:x1874531125821952:12345-0@lo:501: 00000100:00100000:1.0:1787692249.042904:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000062808382 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+6:5812:x1874531125821952:12345-0@lo:501: Request processed in 259us (436us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787692249.042911:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787692249.043035:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053e50eb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125821952:0@lo:501: 10000000:01000000:2.0:1787692249.043066:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787692249.043086:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 00000000c25a56e7/0x5d8b8560a09ddff2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09ddff9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.043095:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 00000000c25a56e7/0x5d8b8560a09ddff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09ddff9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692249.043103:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92ec9dbcc000 10000000:01000000:2.0:1787692249.043107:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787692249.043111:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff92ec9dbcc000 10000000:01000000:2.0:1787692249.043113:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787692249.043115:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff92ec9dbcc000 from 1 10000000:01000000:2.0:1787692249.043117:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787692249.043138:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 000000008becac53/0x5d8b8560a09de000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.043269:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 000000008becac53/0x5d8b8560a09de000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.043277:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 000000008becac53/0x5d8b8560a09de000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692249.043292:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053e50eb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125822080:0@lo:101: 00000100:00100000:2.0:1787692249.043323:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692249.043361:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ea6d31d2 going to sleep for 11 seconds 00000100:00100000:1.0:1787692249.043370:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125822080 00000100:00100000:1.0:1787692249.043376:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125822080 00000100:00100000:1.0:1787692249.043416:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787692249.043424:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002289fdaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+6:5812:x1874531125822080:12345-0@lo:101: 00010000:00010000:1.0:1787692249.043432:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692249.043443:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a68899f/0x5d8b8560a09de007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de000 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.043459:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a68899f/0x5d8b8560a09de007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de000 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.043467:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a68899f/0x5d8b8560a09de007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de000 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.043474:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a68899f, rc 0) 00000100:00100000:1.0:1787692249.043504:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002289fdaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+7:5812:x1874531125822080:12345-0@lo:101: Request processed in 82us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692249.043510:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787692249.043680:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053e50eb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125822080:0@lo:101: 00010000:00010000:2.0:1787692249.043691:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 000000008becac53/0x5d8b8560a09de000 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.043700:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 000000008becac53/0x5d8b8560a09de000 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692249.043711:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787692249.043725:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 000000008becac53/0x5d8b8560a09de000 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.043732:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 000000008becac53/0x5d8b8560a09de000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692249.043738:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787692249.043741:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787692249.043747:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff92ec9dbcc000 10000000:01000000:2.0:1787692249.043749:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787692249.043752:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787692249.043760:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787692249.043774:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 000000004a78a128/0x5d8b8560a09de00e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.043781:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 000000004a78a128/0x5d8b8560a09de00e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.043787:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 000000004a78a128/0x5d8b8560a09de00e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692249.043798:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053e50eb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125822208:0@lo:101: 00000100:00100000:2.0:1787692249.043852:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692249.043868:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ea6d31d2 going to sleep for 11 seconds 00000100:00100000:3.0:1787692249.043922:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125822208 00000100:00100000:3.0:1787692249.043927:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125822208 00000100:00100000:3.0:1787692249.043961:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787692249.043968:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000389d5d70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+7:5812:x1874531125822208:12345-0@lo:101: 00010000:00010000:3.0:1787692249.043976:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692249.043985:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fa876a02/0x5d8b8560a09de015 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de00e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.043999:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fa876a02/0x5d8b8560a09de015 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de00e expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.044007:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fa876a02/0x5d8b8560a09de015 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de00e expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.044014:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fa876a02, rc 0) 00000100:00100000:3.0:1787692249.044059:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000389d5d70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+8:5812:x1874531125822208:12345-0@lo:101: Request processed in 91us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692249.044075:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787692249.044092:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053e50eb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125822208:0@lo:101: 00010000:00010000:1.0:1787692249.044110:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 000000004a78a128/0x5d8b8560a09de00e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de015 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.044116:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 000000004a78a128/0x5d8b8560a09de00e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de015 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692249.044171:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d70b016a pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125822336:0@lo:501: 00000100:00100000:1.0:1787692249.044200:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692249.044213:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000008f2a07a2 going to sleep for 11 seconds 00000100:00100000:1.0:1787692249.044224:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125822336 00000100:00100000:1.0:1787692249.044227:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125822336 00000100:00100000:1.0:1787692249.044248:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787692249.044253:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3c48ee6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+8:5812:x1874531125822336:12345-0@lo:501: 00000100:00100000:1.0:1787692249.044458:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3c48ee6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+9:5812:x1874531125822336:12345-0@lo:501: Request processed in 204us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692249.044465:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787692249.046473:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d70b016a pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125822336:0@lo:501: 00000100:00100000:0.0:1787692249.046586:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055a10dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125822464:0@lo:503: 00000100:00100000:0.0:1787692249.046662:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692249.046711:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b071dd8 going to sleep for 11 seconds 00000100:00100000:1.0:1787692249.046880:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125822464 00000100:00100000:1.0:1787692249.046889:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125822464 00000100:00100000:1.0:1787692249.046946:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787692249.046955:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000054bee47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+9:5812:x1874531125822464:12345-0@lo:503: 00000100:00100000:1.0:1787692249.047261:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000054bee47 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+9:5812:x1874531125822464:12345-0@lo:503: Request processed in 306us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692249.047270:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787692249.047482:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055a10dab pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125822464:0@lo:503: 00000100:00100000:0.0:1787692249.050728:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055a10dab pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:5854:1874531125822592:0@lo:502: 00000100:00100000:1.0:1787692249.051250:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692249.051886:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 000000007cc86113 going to sleep for 11 seconds 00000100:00100000:2.0:1787692249.052581:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125822592 00000100:00100000:2.0:1787692249.052594:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125822592 00000100:00100000:2.0:1787692249.052669:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787692249.052679:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006b91927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+9:5854:x1874531125822592:12345-0@lo:502: 00000100:00100000:2.0:1787692249.053021:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006b91927 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+9:5854:x1874531125822592:12345-0@lo:502: Request processed in 343us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692249.053031:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787692249.054046:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055a10dab pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:5854:1874531125822592:0@lo:502: 00000020:01000000:3.0:1787692249.054095:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787692249.054108:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692249.054111:0:5854:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787692249.054116:0:5854:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1787692249.054120:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787692249.054138:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000001a4eb2c0) 00000020:00000080:3.0:1787692249.054160:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1787692249.054166:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1787692249.054287:0:5854:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1787692249.054296:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09de023 00000020:00000080:3.0:1787692249.054671:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787692249.054677:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787692249.054681:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692249.054682:0:5854:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1787692249.054685:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787692249.054688:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692249.054689:0:5854:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1787692249.054693:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787692249.054701:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000007ce29693) 00000020:00000080:3.0:1787692249.054711:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1787692249.054715:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1787692249.054716:0:5854:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1787692249.054719:0:5854:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1787692249.054725:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787692249.054793:0:5854:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000435c5f94 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1787692249.054808:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000051b60cb4) 00000020:00000080:3.0:1787692249.054859:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787692249.055000:0:5854:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787692249.055008:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d8b8560a09de038 00000020:00000080:2.0:1787692249.055141:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787692249.055148:0:5854:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787692249.055158:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5d8b8560a09de03f 00080000:01000000:2.0:1787692249.055163:0:5854:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787692249.055167:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09de046 00080000:10000000:2.0:1787692249.055597:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1787692249.055870:0:5854:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1787692249.062649:0:5854:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787692249.183305:0:5854:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787692249.183689:0:5854:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787692249.187136:0:5854:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787692249.187460:0:5854:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787692249.213973:0:5854:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000a68d35b4) 00000020:00000080:2.0:1787692249.214001:0:5854:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787692249.214078:0:5854:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787692249.214086:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09de054 00000020:00000080:2.0:1787692249.214740:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1787692249.216254:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692249.251047:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692249.289286:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692249.328880:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692249.373547:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787692249.419215:0:5854:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1787692249.447800:0:5854:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5d8b8560a09de05b 00000020:00000080:1.0:1787692249.448360:0:5854:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787692249.448380:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692249.448385:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692249.448388:0:5854:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787692249.448391:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787692249.448395:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692249.448396:0:5854:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787692249.448399:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787692249.448401:0:5854:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787692249.448404:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692249.448406:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692249.448407:0:5854:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787692249.448409:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787692249.448414:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692249.448415:0:5854:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787692249.448418:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787692249.448461:0:5854:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787692249.448530:0:5854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b19fc28a pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:5854:1874531125822720:0@lo:502: 00000100:00100000:1.0:1787692249.448623:0:5854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692249.448694:0:5854:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042087fd9 going to sleep for 11 seconds 00000100:00100000:2.0:1787692249.448866:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125822720 00000100:00100000:2.0:1787692249.448875:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125822720 00000100:00100000:2.0:1787692249.448922:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787692249.448931:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2e5db00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+9:5854:x1874531125822720:12345-0@lo:502: 00000100:00100000:2.0:1787692249.449379:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2e5db00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+9:5854:x1874531125822720:12345-0@lo:502: Request processed in 447us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692249.449388:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787692249.449554:0:5854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b19fc28a pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:5854:1874531125822720:0@lo:502: 00000020:01000000:0.0:1787692249.449586:0:5854:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787692249.449592:0:5854:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692249.449594:0:5854:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787692249.449598:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1787692249.449781:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1787692249.449802:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787692249.450015:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 000000004a78a128/0x5d8b8560a09de00e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de015 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.450027:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 000000004a78a128/0x5d8b8560a09de00e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de015 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692249.450035:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92ec9dbcc000 from 1 10000000:01000000:2.0:1787692249.450038:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787692249.450074:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.450094:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.450104:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692249.450122:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd3d76d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125822848:0@lo:101: 00000100:00100000:2.0:1787692249.450163:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692249.450197:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000003bd443b0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692249.450261:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125822848 00000100:00100000:1.0:1787692249.450268:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125822848 00000100:00100000:1.0:1787692249.450314:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787692249.450321:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e40623d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+9:5812:x1874531125822848:12345-0@lo:101: 00010000:00010000:1.0:1787692249.450341:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692249.450356:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d1aee2a6/0x5d8b8560a09de069 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de062 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.450380:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1aee2a6/0x5d8b8560a09de069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de062 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.450391:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d1aee2a6/0x5d8b8560a09de069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de062 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.450408:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d1aee2a6, rc 0) 00000100:00100000:1.0:1787692249.450441:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e40623d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+10:5812:x1874531125822848:12345-0@lo:101: Request processed in 120us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692249.450448:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787692249.450583:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd3d76d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125822848:0@lo:101: 00010000:00010000:2.0:1787692249.450596:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de069 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.450605:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de069 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692249.451209:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd3d76d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125822976:0@lo:256: 00000100:00100000:2.0:1787692249.451258:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692249.451284:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000003bd443b0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692249.451391:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125822976 00000100:00100000:2.0:1787692249.451396:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125822976 00000100:00100000:2.0:1787692249.451431:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787692249.451437:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e07d5cac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+10:5812:x1874531125822976:12345-0@lo:256: 20000000:01000000:2.0:1787692249.451455:0:5823:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787692249.451461:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787692249.451529:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e07d5cac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+10:5812:x1874531125822976:12345-0@lo:256: Request processed in 93us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692249.451546:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787692249.451585:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd3d76d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125822976:0@lo:256: 10000000:01000000:2.0:1787692249.452218:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787692249.452604:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de069 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.452618:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de069 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692249.452626:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ec9dbcc000 from 1 10000000:01000000:2.0:1787692249.452629:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787692249.452664:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.452673:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.452682:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692249.452698:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd3d76d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125823104:0@lo:101: 00000100:00100000:2.0:1787692249.452746:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692249.452784:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000003bd443b0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692249.452851:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125823104 00000100:00100000:3.0:1787692249.452858:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125823104 00000100:00100000:3.0:1787692249.452905:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787692249.452913:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d44f487 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+10:5812:x1874531125823104:12345-0@lo:101: 00010000:00010000:3.0:1787692249.452924:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692249.452939:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000041ac6674/0x5d8b8560a09de077 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de070 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.452962:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041ac6674/0x5d8b8560a09de077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de070 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.452973:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000041ac6674/0x5d8b8560a09de077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de070 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.452983:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000041ac6674, rc 0) 00000100:00100000:3.0:1787692249.453029:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d44f487 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+11:5812:x1874531125823104:12345-0@lo:101: Request processed in 118us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692249.453036:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787692249.453124:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd3d76d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125823104:0@lo:101: 00010000:00010000:2.0:1787692249.453140:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de077 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.453149:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de077 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692249.453221:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd3d76d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125823232:0@lo:501: 00000100:00100000:2.0:1787692249.453248:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692249.453281:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000003bd443b0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692249.453483:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125823232 00000100:00100000:1.0:1787692249.453489:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125823232 00000100:00100000:1.0:1787692249.453523:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787692249.453530:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006700fa18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+11:5812:x1874531125823232:12345-0@lo:501: 00000100:00100000:1.0:1787692249.454118:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006700fa18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+11:5812:x1874531125823232:12345-0@lo:501: Request processed in 588us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692249.454126:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787692249.454214:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd3d76d9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125823232:0@lo:501: 00000100:00100000:1.0:1787692249.454252:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000001a16730 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125823360:0@lo:503: 00000100:00100000:1.0:1787692249.454293:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692249.454531:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c72741b going to sleep for 11 seconds 00000100:00100000:2.0:1787692249.454636:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125823360 00000100:00100000:2.0:1787692249.454642:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125823360 00000100:00100000:2.0:1787692249.454668:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787692249.454675:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d94149e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+11:5812:x1874531125823360:12345-0@lo:503: 00000040:00080000:2.0:1787692249.454714:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787692249.454800:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d94149e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+11:5812:x1874531125823360:12345-0@lo:503: Request processed in 126us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692249.454807:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787692249.455149:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000001a16730 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125823360:0@lo:503: 00000040:00080000:3.0:1787692249.456197:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787692249.456530:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787692249.456550:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787692249.456572:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de077 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.456584:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de077 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692249.456633:0:5812:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787692249.456636:0:5812:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92ec9dbcc000 10000000:01000000:0.0:1787692249.456639:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92ec9dbcc000 10000000:01000000:0.0:1787692249.456643:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787692249.456650:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ec9dbcc000 from 1 10000000:01000000:0.0:1787692249.456653:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787692249.456697:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 000000007486033e/0x5d8b8560a09de07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.456718:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 000000007486033e/0x5d8b8560a09de07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.456731:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 000000007486033e/0x5d8b8560a09de07e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692249.456753:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a622901d pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125823488:0@lo:101: 00000100:00100000:0.0:1787692249.456836:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692249.456871:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000007cc86113 going to sleep for 11 seconds 00000100:00100000:2.0:1787692249.456951:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125823488 00000100:00100000:2.0:1787692249.456960:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125823488 00000100:00100000:2.0:1787692249.457008:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787692249.457016:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000220f56c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+11:5812:x1874531125823488:12345-0@lo:101: 00010000:00010000:2.0:1787692249.457029:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692249.457044:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008accfefd/0x5d8b8560a09de085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de07e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.457069:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008accfefd/0x5d8b8560a09de085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de07e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.457078:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008accfefd/0x5d8b8560a09de085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de07e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692249.457087:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008accfefd, rc 0) 00000100:00100000:2.0:1787692249.457124:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000220f56c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:5812:x1874531125823488:12345-0@lo:101: Request processed in 109us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692249.457138:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787692249.457229:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a622901d pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125823488:0@lo:101: 00010000:00010000:0.0:1787692249.457243:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 000000007486033e/0x5d8b8560a09de07e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de085 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.457251:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 000000007486033e/0x5d8b8560a09de07e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de085 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692249.457310:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a622901d pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125823616:0@lo:501: 00000100:00100000:0.0:1787692249.457347:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692249.457370:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000007cc86113 going to sleep for 11 seconds 00000100:00100000:2.0:1787692249.457601:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125823616 00000100:00100000:2.0:1787692249.457606:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125823616 00000100:00100000:2.0:1787692249.457635:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787692249.457641:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de0017b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:5812:x1874531125823616:12345-0@lo:501: 00000100:00100000:2.0:1787692249.457915:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de0017b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:5812:x1874531125823616:12345-0@lo:501: Request processed in 273us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692249.457922:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787692249.458112:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a622901d pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125823616:0@lo:501: 00000100:00100000:0.0:1787692249.458141:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a622901d pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125823744:0@lo:503: 00000100:00100000:0.0:1787692249.458182:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692249.458200:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000007cc86113 going to sleep for 11 seconds 00000100:00100000:2.0:1787692249.458249:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125823744 00000100:00100000:2.0:1787692249.458253:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125823744 00000100:00100000:2.0:1787692249.458283:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787692249.458289:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004200e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:5812:x1874531125823744:12345-0@lo:503: 00000100:00100000:2.0:1787692249.458709:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004200e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:5812:x1874531125823744:12345-0@lo:503: Request processed in 419us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692249.458717:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787692249.458806:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a622901d pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125823744:0@lo:503: 00000100:00100000:3.0:1787692249.459261:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0499184 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:5859:1874531125823872:0@lo:502: 00000100:00100000:3.0:1787692249.459603:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692249.459641:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b91ad9ed going to sleep for 11 seconds 00000100:00100000:2.0:1787692249.459697:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125823872 00000100:00100000:2.0:1787692249.459703:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125823872 00000100:00100000:2.0:1787692249.459743:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787692249.459750:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dbcdee1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:5859:x1874531125823872:12345-0@lo:502: 00000100:00100000:2.0:1787692249.460008:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dbcdee1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:5859:x1874531125823872:12345-0@lo:502: Request processed in 258us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692249.460016:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787692249.460170:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0499184 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:5859:1874531125823872:0@lo:502: 00000020:01000004:3.0:1787692249.460234:0:5859:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1787692249.460268:0:5859:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000a923760c) 00000020:00000080:3.0:1787692249.460291:0:5859:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1787692249.460506:0:5859:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000435c5f94 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787692249.460511:0:5859:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000435c5f94 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1787692249.460513:0:5859:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000435c5f94 4 00010000:00080000:3.0:1787692249.460556:0:5859:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b99c75d5@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.127@tcp at head 00010000:00010000:2.0:1787692249.463275:0:5859:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787692249.463677:0:5859:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787692249.463722:0:5859:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787692249.463736:0:5859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5d8b8560a09de093 00000100:00080000:2.0:1787692249.463749:0:5859:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787692249.463761:0:5859:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b99c75d5 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:2.0:1787692249.463809:0:5859:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bd578fc2 x1874531125824000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787692249.464045:0:5859:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787692249.466116:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd578fc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874531125824000:0@lo:38: 00000100:00100000:1.0:1787692249.466212:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692249.469102:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125824000 00000100:00100000:3.0:1787692249.469119:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125824000 00000100:00100000:3.0:1787692249.469198:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787692249.469207:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011267cee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874531125824000:12345-0@lo:38: 00000100:00100000:3.0:1787692249.469318:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011267cee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874531125824000:12345-0@lo:38: Request processed in 111us (3107us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787692249.469325:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787692249.469594:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057126b2c pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:5859:1874531125824128:0@lo:502: 00000100:00100000:0.0:1787692249.469653:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692249.469696:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125824128 00000100:00100000:0.0:1787692249.469700:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125824128 00000100:00100000:0.0:1787692249.469738:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787692249.469744:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006180a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:5859:x1874531125824128:12345-0@lo:502: 00000100:00100000:0.0:1787692249.469986:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006180a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:5859:x1874531125824128:12345-0@lo:502: Request processed in 242us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692249.469993:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787692249.470128:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e757bdc going to sleep for 11 seconds 00000100:00100000:0.0:1787692249.470153:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057126b2c pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:5859:1874531125824128:0@lo:502: 00000040:00080000:0.0:1787692249.470183:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1787692249.470241:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1787692249.470261:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787692249.470277:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 000000007486033e/0x5d8b8560a09de07e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de085 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.470286:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 000000007486033e/0x5d8b8560a09de07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de085 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787692249.471092:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787692249.471095:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787692249.471096:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787692249.471097:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787692249.471099:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787692249.471101:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787692249.471102:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787692249.471104:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787692249.471105:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787692249.471107:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787692249.471109:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787692249.471110:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787692249.471114:0:5812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1787692249.471117:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787692249.471124:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787692249.471124:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787692249.471125:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787692249.471126:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787692249.471127:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787692249.471128:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787692249.471129:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787692249.471130:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787692249.471130:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787692249.471131:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787692249.471132:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787692249.471154:0:5812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787692249.471167:0:5812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057126b2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125824256:0@lo:253: 00000100:00100000:0.0:1787692249.471221:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692249.471255:0:5812:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b071dd8 going to sleep for 11 seconds 00000100:00100000:0.0:1787692249.471414:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125824256 00000100:00100000:0.0:1787692249.471420:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125824256 00000100:00100000:0.0:1787692249.471459:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787692249.471466:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fba55d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:5812:x1874531125824256:12345-0@lo:253: 20000000:01000000:0.0:1787692249.471505:0:5826:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787692249.471523:0:5826:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787692249.474217:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787692249.474229:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000b99c75d5 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787692249.474237:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787692249.474241:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd578fc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874531125824000:0@lo:38: 20000000:01000000:0.0:1787692249.501378:0:5826:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787692249.501428:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1787692249.501599:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787692249.501605:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787692249.501631:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.501656:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d1aee2a6/0x5d8b8560a09de069 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de062 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.501664:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.501732:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d1aee2a6/0x5d8b8560a09de069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de062 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.501749:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d1aee2a6/0x5d8b8560a09de069 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de062 expref: 12 pid: 5825 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692249.501765:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002dda8198 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874531125824384:0@lo:104: 00000100:00100000:1.0:1787692249.501890:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692249.501976:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c72741b going to sleep for 11 seconds 00000100:00100000:3.0:1787692249.502076:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125824384 00000100:00100000:3.0:1787692249.502087:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125824384 00000100:00100000:3.0:1787692249.502147:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787692249.502157:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b64e3b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+3:5847:x1874531125824384:12345-0@lo:104: 00010000:00010000:3.0:1787692249.502171:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de069 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.502248:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787692249.502254:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b64e3b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+3:5847:x1874531125824384:12345-0@lo:104: Request processed in 100us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692249.502263:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1787692249.502286:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692249.502291:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de069 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.502311:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000076ef56bf already unused, calling callback (0000000012eaf340) 10000000:00010000:3.0:1787692249.502325:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de069 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.502343:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de069 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787692249.502350:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de069 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692249.502355:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787692249.502389:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de069 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.502396:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787692249.502415:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de069 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.502422:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de062 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de069 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692249.502440:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692249.502442:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692249.502443:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692249.502568:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002dda8198 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874531125824384:0@lo:104: 00010000:00010000:2.0:1787692249.502591:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692249.502768:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787692249.502780:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0499184 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125824512:0@lo:103: 00000100:00100000:1.0:1787692249.502902:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692249.506133:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125824512 00000100:00100000:0.0:1787692249.506155:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125824512 00010000:00010000:0.0:1787692249.506202:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d1aee2a6/0x5d8b8560a09de069 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de062 expref: 13 pid: 5825 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692249.506255:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787692249.506282:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033afd94a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+13:3304:x1874531125824512:12345-0@lo:103: 00010000:00010000:0.0:1787692249.506312:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692249.506319:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d1aee2a6/0x5d8b8560a09de069 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de062 expref: 13 pid: 5825 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.506340:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d1aee2a6/0x5d8b8560a09de069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de062 expref: 13 pid: 5825 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.506360:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d1aee2a6/0x5d8b8560a09de069 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de062 expref: 13 pid: 5825 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.506380:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.506389:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787692249.506407:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004802226s 00010000:00010000:0.0:1787692249.506411:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.506417:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.506423:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.506429:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.506434:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006e100ded already unused, calling callback (00000000baa2c9ff) 00010000:00010000:0.0:1787692249.506444:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.506452:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.506475:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692249.506488:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692249.506574:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033afd94a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+12:3304:x1874531125824512:12345-0@lo:103: Request processed in 295us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692249.506582:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787692249.506667:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0499184 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125824512:0@lo:103: 00010000:00010000:1.0:1787692249.506703:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.506711:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692249.506716:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006e100ded/0x5d8b8560a09de09a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692249.512068:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fba55d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+11:5812:x1874531125824256:12345-0@lo:253: Request processed in 40592us (40837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692249.512087:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787692249.512232:0:5812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057126b2c pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:5812:1874531125824256:0@lo:253: 10000000:01000000:1.0:1787692249.512250:0:5812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787692249.512253:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787692249.512255:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787692249.512256:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787692249.512258:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787692249.512278:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787692249.512279:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787692249.512280:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787692249.512282:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787692249.512283:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787692249.512285:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787692249.512286:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787692249.512288:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787692249.512411:0:5812:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787692249.520193:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787692249.520716:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787692249.521212:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787692249.521484:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787692249.521720:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787692249.521900:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787692249.524927:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787692249.525412:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787692249.525648:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787692249.525990:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787692249.526233:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787692249.526505:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787692249.567539:0:5812:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:3.0:1787692249.603487:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787692249.605053:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787692249.605288:0:5864:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787692249.605293:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1787692249.605504:0:5865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787692249.608991:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787692249.609189:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787692249.610027:0:5812:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787692249.610052:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787692249.610237:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787692249.611269:0:5812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787692249.611870:0:5812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787692249.611909:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787692249.612185:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787692249.612401:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787692249.624043:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787692249.624197:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787692249.624385:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787692249.624541:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787692249.624699:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787692249.624942:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787692249.625117:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787692249.625258:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787692249.625432:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787692249.625577:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787692249.626892:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787692249.627073:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787692249.627239:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787692249.627418:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787692249.627614:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787692249.627762:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787692249.628136:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787692249.628283:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787692249.628463:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787692249.628616:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787692249.628783:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787692249.628976:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787692249.629131:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787692249.629274:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787692249.629457:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787692249.636096:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787692249.636494:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787692249.636879:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787692249.637120:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787692249.637418:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787692249.637785:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1787692249.637960:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787692249.638408:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1787692249.645996:0:5865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787692249.753557:0:5812:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787692249.753603:0:5812:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7eb41d9b988 00100000:10000000:2.0:1787692249.753613:0:5812:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787692249.754003:0:5812:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787692249.754020:0:5812:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787692249.754036:0:5812:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787692249.754066:0:5812:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1787692249.835466:0:5865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787692249.835740:0:5865:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787692249.835745:0:5865:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1787692250.629067:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692251.649332:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692252.673225:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692253.703058:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692254.531300:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000085103efd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125824640:0@lo:400: 00000100:00100000:3.0:1787692254.531390:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787692254.531523:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787692254.531529:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787692254.531531:0:37:0:(import.c:65:import_set_state_nolock()) 00000000b99c75d5 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787692254.531540:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000b99c75d5 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:0.0:1787692254.531564:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000751ca96 x1874531125824768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787692254.531622:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125824640 00000100:00100000:0.0:1787692254.531629:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125824640 00000100:00100000:0.0:1787692254.531671:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787692254.531679:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093e2ce21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+11:3306:x1874531125824640:12345-0@lo:400: 00000100:00100000:0.0:1787692254.535889:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093e2ce21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+11:3306:x1874531125824640:12345-0@lo:400: Request processed in 4202us (4490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692254.535908:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787692254.535978:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000751ca96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874531125824768:0@lo:38: 00000100:00100000:0.0:1787692254.536039:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692254.536213:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125824768 00000100:00100000:2.0:1787692254.536222:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125824768 00000100:00100000:2.0:1787692254.536252:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787692254.536258:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051c1af0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874531125824768:12345-0@lo:38: 00010000:00080000:2.0:1787692254.536290:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:2.0:1787692254.536344:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5d8b8560a09de0a1 00000004:00100000:2.0:1787692254.536391:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787692254.536543:0:5833:0:(import.c:65:import_set_state_nolock()) 00000000fb63c3bb : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787692254.536596:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051c1af0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874531125824768:12345-0@lo:38: Request processed in 337us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692254.536603:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787692254.536792:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000751ca96 x1874531125824768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787692264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787692254.536809:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787692254.536846:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787692254.536851:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787692254.536854:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000b99c75d5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787692254.536860:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000751ca96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874531125824768:0@lo:38: 00000100:00100000:3.0:1787692254.537852:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000085103efd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125824640:0@lo:400: 00010000:00010000:0.0:1787692254.723988:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787692254.816372:0:6108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787692255.746158:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787692256.577773:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787692256.577783:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92ec9dbcc000 from 3 10000000:01000000:0.0:1787692256.577788:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787692256.577844:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 000000008003f75f/0x5d8b8560a09de0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692256.577858:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 000000008003f75f/0x5d8b8560a09de0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692256.577869:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 000000008003f75f/0x5d8b8560a09de0a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692256.577892:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000751ca96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125824896:0@lo:101: 00000100:00100000:0.0:1787692256.578035:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692256.578090:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000046669fb0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692256.579432:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125824896 00000100:00100000:3.0:1787692256.579447:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125824896 00000100:00100000:3.0:1787692256.579512:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787692256.579521:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d5f3756 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+11:5828:x1874531125824896:12345-0@lo:101: 00010000:00010000:3.0:1787692256.579539:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692256.579563:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000079365997/0x5d8b8560a09de0af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de0a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692256.579588:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000079365997/0x5d8b8560a09de0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de0a8 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692256.579598:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000079365997/0x5d8b8560a09de0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de0a8 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692256.579606:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000079365997, rc 0) 00000100:00100000:3.0:1787692256.579671:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d5f3756 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:5828:x1874531125824896:12345-0@lo:101: Request processed in 152us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692256.579678:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787692256.579848:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000751ca96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125824896:0@lo:101: 00010000:00010000:0.0:1787692256.579868:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 000000008003f75f/0x5d8b8560a09de0a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de0af expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692256.579879:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 000000008003f75f/0x5d8b8560a09de0a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de0af expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692256.580379:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000751ca96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125825024:0@lo:256: 00000100:00100000:0.0:1787692256.580430:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692256.580474:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000046669fb0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692256.580861:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125825024 00000100:00100000:3.0:1787692256.580868:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125825024 00000100:00100000:3.0:1787692256.580906:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787692256.580914:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ad7e289 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:5828:x1874531125825024:12345-0@lo:256: 20000000:01000000:3.0:1787692256.580933:0:5823:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787692256.580946:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787692256.580949:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787692256.581046:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ad7e289 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:5828:x1874531125825024:12345-0@lo:256: Request processed in 133us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692256.581053:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787692256.581117:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000751ca96 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125825024:0@lo:256: 10000000:01000000:0.0:1787692256.581160:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787692256.581166:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: 000000008003f75f/0x5d8b8560a09de0a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de0af expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692256.581175:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: 000000008003f75f/0x5d8b8560a09de0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de0af expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692256.769009:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692257.793245:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692258.816912:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787692259.554317:0:6310:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4119e380 20000000:00000080:2.0:1787692259.554335:0:6310:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92ecb5b98800 uarg=0000000000000000 20000000:01000000:2.0:1787692259.554371:0:6310:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787692259.554378:0:6310:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787692259.554389:0:6310:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787692259.554667:0:6310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787692259.554679:0:6310:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787692259.558754:0:6310:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787692259.559385:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787692259.559456:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787692259.559511:0:6310:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787692259.559530:0:6310:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787692259.559548:0:6310:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692259.559565:0:6310:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000041ac6674/0x5d8b8560a09de077 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de070 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692259.559572:0:6310:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692259.559612:0:6310:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000041ac6674/0x5d8b8560a09de077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de070 expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692259.559627:0:6310:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000041ac6674/0x5d8b8560a09de077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de070 expref: 11 pid: 5823 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692259.559640:0:6310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c4df12cc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6310:1874531125825152:0@lo:104: 00000100:00100000:2.0:1787692259.560021:0:6310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692259.560079:0:6310:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca8ac88a going to sleep for 11 seconds 00000100:00100000:1.0:1787692259.560149:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125825152 00000100:00100000:1.0:1787692259.560157:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125825152 00000100:00100000:1.0:1787692259.560340:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787692259.560350:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052acc7b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+3:6310:x1874531125825152:12345-0@lo:104: 00010000:00010000:1.0:1787692259.560362:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de077 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692259.560478:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787692259.560483:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052acc7b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+3:6310:x1874531125825152:12345-0@lo:104: Request processed in 136us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692259.560490:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787692259.560579:0:6310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c4df12cc pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6310:1874531125825152:0@lo:104: 00010000:00010000:2.0:1787692259.560596:0:6310:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692259.560628:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692259.560633:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de077 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692259.560642:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b9054096 already unused, calling callback (0000000012eaf340) 10000000:00010000:0.0:1787692259.560645:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de077 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692259.560663:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de077 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692259.560669:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de077 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692259.560676:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787692259.560744:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de077 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692259.560752:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787692259.560800:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000751ca96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125825280:0@lo:103: 00000100:00100000:3.0:1787692259.560849:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787692259.560903:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de077 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692259.560911:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: 00000000b9054096/0x5d8b8560a09de070 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de077 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692259.560979:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692259.560980:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692259.560982:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692259.561057:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125825280 00000100:00100000:1.0:1787692259.561061:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125825280 00010000:00010000:1.0:1787692259.561078:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000041ac6674/0x5d8b8560a09de077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de070 expref: 12 pid: 5823 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692259.561109:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787692259.561115:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a09b6e79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+12:3307:x1874531125825280:12345-0@lo:103: 00010000:00010000:1.0:1787692259.561125:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692259.561130:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000041ac6674/0x5d8b8560a09de077 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de070 expref: 12 pid: 5823 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692259.561139:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000041ac6674/0x5d8b8560a09de077 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de070 expref: 12 pid: 5823 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692259.561151:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000041ac6674/0x5d8b8560a09de077 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de070 expref: 12 pid: 5823 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692259.561163:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692259.561170:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692259.561180:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692259.561196:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692259.561201:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692259.561207:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692259.561212:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000268b3a14 already unused, calling callback (00000000baa2c9ff) 00010000:00010000:1.0:1787692259.561214:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692259.561220:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692259.561233:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692259.561242:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787692259.561420:0:6310:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692259.561433:0:6310:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692259.561439:0:6310:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000268b3a14/0x5d8b8560a09de0b6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6310 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692259.563568:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a09b6e79 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+11:3307:x1874531125825280:12345-0@lo:103: Request processed in 2446us (2711us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692259.563582:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787692259.564415:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000751ca96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125825280:0@lo:103: 00000100:00100000:0.0:1787692259.649263:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787692259.649299:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f0a94165 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125825408:0@lo:400: 00000100:00100000:0.0:1787692259.649373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692259.649500:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125825408 00000100:00100000:3.0:1787692259.649508:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125825408 00000100:00100000:3.0:1787692259.649560:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787692259.649567:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b58cbb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125825408:12345-0@lo:400: 00000100:00100000:3.0:1787692259.649629:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b58cbb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125825408:12345-0@lo:400: Request processed in 63us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692259.649637:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787692259.649679:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f0a94165 x1874531125825408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692259.649693:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f0a94165 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125825408:0@lo:400: 00010000:00010000:0.0:1787692259.841027:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692260.864909:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692261.898772:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692262.913807:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787692262.917877:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787692262.917884:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ec9dbcc000 from 1 10000000:01000000:2.0:1787692262.917888:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787692262.917940:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de0bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692262.917954:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de0bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692262.917966:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de0bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692262.917996:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c4df12cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125825536:0@lo:101: 00000100:00100000:2.0:1787692262.918082:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692262.918147:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125825536 00000100:00100000:0.0:1787692262.918157:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125825536 00000100:00100000:0.0:1787692262.918217:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787692262.918309:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5da2596 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+11:5828:x1874531125825536:12345-0@lo:101: 00010000:00010000:0.0:1787692262.918334:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692262.918349:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be7b3415/0x5d8b8560a09de0c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de0bd expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692262.918372:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be7b3415/0x5d8b8560a09de0c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de0bd expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692262.918382:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be7b3415/0x5d8b8560a09de0c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de0bd expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692262.918391:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be7b3415, rc 0) 00000100:00100000:0.0:1787692262.918427:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5da2596 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:5828:x1874531125825536:12345-0@lo:101: Request processed in 202us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692262.918433:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787692262.919252:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000081b260e8 going to sleep for 11 seconds 00000100:00100000:2.0:1787692262.919294:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c4df12cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125825536:0@lo:101: 00010000:00010000:2.0:1787692262.919313:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de0bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de0c4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692262.919323:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: 0000000076ef56bf/0x5d8b8560a09de0bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de0c4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692262.919404:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c4df12cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125825664:0@lo:501: 00000100:00100000:2.0:1787692262.919449:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692262.919482:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000081b260e8 going to sleep for 11 seconds 00000100:00100000:0.0:1787692262.919776:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125825664 00000100:00100000:0.0:1787692262.919784:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125825664 00000100:00100000:0.0:1787692262.919923:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787692262.919931:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab6a3469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+12:5828:x1874531125825664:12345-0@lo:501: 00000100:00100000:0.0:1787692262.920534:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab6a3469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+12:5828:x1874531125825664:12345-0@lo:501: Request processed in 602us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692262.920543:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787692262.920833:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c4df12cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125825664:0@lo:501: 00000100:00100000:2.0:1787692262.920884:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c4df12cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125825792:0@lo:503: 00000100:00100000:2.0:1787692262.920930:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692262.920957:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125825792 00000100:00100000:2.0:1787692262.920963:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set 0000000081b260e8 going to sleep for 11 seconds 00000100:00100000:0.0:1787692262.920963:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125825792 00000100:00100000:0.0:1787692262.921423:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787692262.921434:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcf2c125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:5828:x1874531125825792:12345-0@lo:503: 00000100:00100000:0.0:1787692262.921769:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcf2c125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:5828:x1874531125825792:12345-0@lo:503: Request processed in 337us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692262.921777:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787692262.921927:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c4df12cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125825792:0@lo:503: 00000100:00100000:2.0:1787692262.922590:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000000e5997a pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:6539:1874531125825920:0@lo:502: 00000100:00100000:2.0:1787692262.922646:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692262.922673:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125825920 00000100:00100000:0.0:1787692262.922679:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125825920 00000100:00100000:2.0:1787692262.922680:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 0000000081b260e8 going to sleep for 11 seconds 00000100:00100000:0.0:1787692262.922718:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787692262.922726:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002443099a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+12:6539:x1874531125825920:12345-0@lo:502: 00000100:00100000:0.0:1787692262.923487:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002443099a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+12:6539:x1874531125825920:12345-0@lo:502: Request processed in 758us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692262.923497:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787692262.923566:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000000e5997a pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:6539:1874531125825920:0@lo:502: 00000020:01000000:2.0:1787692262.923597:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787692262.923608:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787692262.923611:0:6539:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787692262.923620:0:6539:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ec9dbcc000 00000020:00000080:2.0:1787692262.923622:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787692262.923672:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:6539:1874531125826048:0@lo:502: 00000100:00100000:2.0:1787692262.924224:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692262.924276:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec904c00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692262.924325:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125826048 00000100:00100000:0.0:1787692262.924331:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125826048 00000100:00100000:0.0:1787692262.924373:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787692262.924380:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6539:x1874531125826048:12345-0@lo:502: 00000100:00100000:0.0:1787692262.924562:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6539:x1874531125826048:12345-0@lo:502: Request processed in 181us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692262.924570:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787692262.924807:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:6539:1874531125826048:0@lo:502: 00000020:01000000:2.0:1787692262.924864:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787692262.924869:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787692262.924872:0:6539:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787692262.924877:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787692262.925066:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787692262.925085:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787692262.925098:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a2800/0x5d8b8560a09de0bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de0c4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692262.925110:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec814a2800/0x5d8b8560a09de0bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de0c4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692263.937201:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692264.773298:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125826176:0@lo:400: 00000100:00100000:3.0:1787692264.773371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692264.773438:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125826304:0@lo:400: 00000100:00100000:3.0:1787692264.773470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692264.773507:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125826176 00000100:00100000:3.0:1787692264.773514:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125826176 00000100:00100000:3.0:1787692264.773556:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787692264.773565:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+12:3305:x1874531125826176:12345-0@lo:400: 00000100:00100000:3.0:1787692264.773613:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+12:3305:x1874531125826176:12345-0@lo:400: Request processed in 49us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692264.773630:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787692264.773662:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125826304 00000100:00100000:3.0:1787692264.773667:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125826304 00000100:00100000:3.0:1787692264.773694:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787692264.773701:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125826304:12345-0@lo:400: 00000100:00100000:3.0:1787692264.773741:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125826304:12345-0@lo:400: Request processed in 40us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692264.773747:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787692264.773779:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125826176:0@lo:400: 00010000:00080000:3.0:1787692264.773838:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92ecae9fc000 x1874531125826304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692264.773852:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125826304:0@lo:400: 00010000:00010000:1.0:1787692264.961136:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787692265.839947:0:6676:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787692265.839950:0:6676:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787692265.840074:0:6676:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92ecafbbe800 00000020:01000004:0.0:1787692265.840094:0:6676:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787692265.840108:0:6676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787692265.840126:0:6676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff92ec87e699b8) 00000020:00000080:0.0:1787692265.840144:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787692265.872193:0:6676:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787692265.872473:0:6676:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787692265.918772:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787692265.928107:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787692265.928149:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787692265.928222:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787692265.928266:0:6676:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787692265.928610:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787692265.928622:0:6676:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787692265.928633:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d8b8560a09de0d2 00000020:01000004:2.0:1787692265.928641:0:6676:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787692265.928662:0:6676:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787692265.928673:0:6676:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787692265.928679:0:6676:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787692265.928684:0:6676:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787692265.928696:0:6676:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff92ec87fd0000) 00000020:00000080:2.0:1787692265.928705:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787692265.935374:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787692265.935552:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787692265.935558:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787692265.940903:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787692265.940923:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787692265.945929:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787692265.946088:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787692265.953795:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787692265.954015:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787692265.954022:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787692265.955293:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787692265.955303:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:1.0:1787692265.985088:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692266.001264:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787692266.001507:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787692266.001513:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787692266.003411:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787692266.003425:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787692266.004190:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787692266.004198:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787692266.007304:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787692266.007511:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787692266.007517:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787692266.008119:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787692266.008128:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787692266.076268:0:6676:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787692266.076478:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787692266.076484:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787692266.094131:0:6676:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787692266.094152:0:6676:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787692266.094663:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787692266.094691:0:6676:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787692266.094711:0:6676:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787692266.138507:0:6676:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787692266.138546:0:6676:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.127@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787692266.138551:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787692266.138553:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787692266.138554:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692266.138555:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692266.138557:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692266.138558:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692266.138565:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692266.138566:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787692266.138568:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787692266.138569:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692266.138571:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787692266.138574:0:6676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787692266.138576:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787692266.138578:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787692266.138579:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692266.138579:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692266.138580:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692266.138581:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692266.138582:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692266.138583:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787692266.138584:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787692266.138584:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692266.138585:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787692266.138610:0:6676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787692266.138629:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125826432:0@lo:253: 00000100:00100000:3.0:1787692266.138703:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692266.138776:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec89c40540 going to sleep for 11 seconds 00000100:00100000:0.0:1787692266.140533:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125826432 00000100:00100000:0.0:1787692266.140546:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125826432 00000100:00100000:0.0:1787692266.140601:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787692266.140610:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125826432:12345-0@lo:253: 20000000:01000000:0.0:1787692266.140665:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787692266.140669:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1787692266.140674:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1787692266.140677:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1787692266.141577:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787692266.141763:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1787692266.141776:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1787692266.141809:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1787692266.141844:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1787692266.141872:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1787692266.141912:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1787692266.142275:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1787692266.142294:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.127@tcp 20000000:01000000:0.0:1787692266.142296:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.127@tcp (null) (null) (null) 00000040:00080000:0.0:1787692266.142324:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1787692266.142331:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787692266.142367:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1787692266.142374:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.127@tcp (null) (null) 00000040:00080000:0.0:1787692266.142399:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1787692266.142407:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787692266.142430:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1787692266.142480:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1787692266.147519:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1787692266.147563:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.127@tcp 20000000:01000000:0.0:1787692266.147566:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.127@tcp (null) (null) (null) 00000040:00080000:0.0:1787692266.147665:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1787692266.147674:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787692266.147714:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1787692266.147723:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.127@tcp (null) (null) 00000040:00080000:0.0:1787692266.147806:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1787692266.147837:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1787692266.147880:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1787692266.147915:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1787692266.147937:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787692266.147940:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787692266.147946:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787692266.147948:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787692266.147950:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787692266.147964:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787692266.147967:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787692266.148016:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787692266.148018:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787692266.155611:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787692266.155874:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787692266.155968:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787692266.158326:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787692266.158382:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787692266.158466:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787692266.158482:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787692266.158485:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787692266.167994:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787692266.168573:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787692266.168627:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787692266.168735:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787692266.168750:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787692266.168753:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787692266.169487:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787692266.169557:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787692266.169609:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787692266.170141:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787692266.170184:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787692266.170312:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:1.0:1787692266.170334:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787692266.170356:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.170391:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09ddff9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09ddff2 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.170398:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ecc62cb400/0x5d8b8560a09de015 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de00e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.170405:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de07e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.170412:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.170451:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de07e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.170465:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de07e expref: 12 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692266.170480:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125826560:0@lo:104: 00000100:00100000:1.0:1787692266.170547:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787692266.170649:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ecc62cb400/0x5d8b8560a09de015 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de00e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.170658:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ecc62cb400/0x5d8b8560a09de015 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de00e expref: 12 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692266.170667:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125826688:0@lo:104: 00000100:00100000:1.0:1787692266.170715:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787692266.171162:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09ddff9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09ddff2 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.171179:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09ddff9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09ddff2 expref: 12 pid: 5825 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692266.171189:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125826816:0@lo:104: 00000100:00100000:1.0:1787692266.171228:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692266.171394:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125826560 00000100:00100000:3.0:1787692266.171402:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125826560 00000100:00100000:3.0:1787692266.171440:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125826688 00000100:00100000:3.0:1787692266.171443:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125826688 00000100:00100000:3.0:1787692266.171456:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787692266.171464:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+4:5826:x1874531125826560:12345-0@lo:104: 00010000:00010000:3.0:1787692266.171476:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec80030a00/0x5d8b8560a09de07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de085 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.171533:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787692266.171547:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+4:5826:x1874531125826560:12345-0@lo:104: Request processed in 83us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.171553:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787692266.171570:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787692266.171576:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+3:5826:x1874531125826688:12345-0@lo:104: 00010000:00010000:3.0:1787692266.171584:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09de00e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de015 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.171623:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787692266.171628:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+3:5826:x1874531125826688:12345-0@lo:104: Request processed in 53us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.171633:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787692266.171693:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787692266.171711:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec80030a00/0x5d8b8560a09de07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de085 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.171719:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692266.171723:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec80030a00/0x5d8b8560a09de07e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de085 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.171731:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec80030a00/0x5d8b8560a09de07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de085 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692266.171738:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec80030a00/0x5d8b8560a09de07e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de085 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692266.171744:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787692266.171779:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec80030a00/0x5d8b8560a09de07e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de085 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.171793:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787692266.171835:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec80030a00/0x5d8b8560a09de07e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de085 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.171842:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec80030a00/0x5d8b8560a09de07e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de085 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.171856:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692266.171859:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09de00e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de015 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.171865:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2c00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692266.171868:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09de00e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de015 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.171875:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09de00e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de015 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692266.171881:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09de00e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de015 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692266.171886:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787692266.171899:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09de00e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de015 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.171905:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787692266.171918:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09de00e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de015 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.171925:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09de00e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de015 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.171939:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692266.171940:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692266.171942:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692266.171954:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125826944:0@lo:103: 00000100:00100000:0.0:1787692266.171989:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692266.172029:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125827072:0@lo:103: 00000100:00100000:0.0:1787692266.172052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692266.172086:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125826944 00000100:00100000:0.0:1787692266.172090:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125826944 00010000:00010000:0.0:1787692266.172108:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de085 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de07e expref: 13 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692266.172129:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125827072 00000100:00100000:0.0:1787692266.172132:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125827072 00010000:00010000:0.0:1787692266.172145:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ecc62cb400/0x5d8b8560a09de015 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de00e expref: 14 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692266.172157:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787692266.172164:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+14:3307:x1874531125826944:12345-0@lo:103: 00010000:00010000:0.0:1787692266.172174:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692266.172180:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de085 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de07e expref: 14 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.172190:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de07e expref: 14 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.172206:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692266.172527:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+14:3307:x1874531125826944:12345-0@lo:103: Request processed in 363us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692266.172540:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787692266.172558:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787692266.172564:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+13:3304:x1874531125827072:12345-0@lo:103: 00010000:00010000:0.0:1787692266.172571:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692266.172576:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ecc62cb400/0x5d8b8560a09de015 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de00e expref: 13 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.172585:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ecc62cb400/0x5d8b8560a09de015 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de00e expref: 13 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.172594:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692266.172620:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+13:3304:x1874531125827072:12345-0@lo:103: Request processed in 56us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692266.172626:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787692266.172656:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125827072:0@lo:103: 00000100:00100000:3.0:1787692266.172728:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125826944:0@lo:103: 00010000:00010000:1.0:1787692266.172858:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692266.172871:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a46480 going to sleep for 11 seconds 00010000:00010000:1.0:1787692266.172886:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de07e expref: 12 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692266.172897:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125826560:0@lo:104: 00010000:00010000:1.0:1787692266.172907:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecc62cb400/0x5d8b8560a09de015 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de00e expref: 11 pid: 5823 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692266.172915:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125826688:0@lo:104: 00000100:00100000:3.0:1787692266.173037:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125826816 00000100:00100000:3.0:1787692266.173041:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125826816 00000100:00100000:3.0:1787692266.173064:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787692266.173070:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+3:5826:x1874531125826816:12345-0@lo:104: 00010000:00010000:3.0:1787692266.173080:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09ddff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09ddff9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.173131:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787692266.173136:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+3:5826:x1874531125826816:12345-0@lo:104: Request processed in 67us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.173142:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787692266.173193:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692266.173197:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09ddff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09ddff9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173204:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecc62cba00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692266.173292:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09ddff2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09ddff9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173301:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09ddff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09ddff9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692266.173307:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09ddff2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09ddff9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692266.173323:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787692266.173354:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09ddff2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09ddff9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173360:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787692266.173375:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09ddff2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09ddff9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173382:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09ddff2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09ddff9 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173397:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692266.173399:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692266.173401:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692266.173414:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125827200:0@lo:103: 00000100:00100000:0.0:1787692266.173447:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692266.173478:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125827200 00000100:00100000:0.0:1787692266.173481:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125827200 00010000:00010000:0.0:1787692266.173495:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09ddff9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09ddff2 expref: 11 pid: 5825 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692266.173511:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787692266.173516:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+11:3305:x1874531125827200:12345-0@lo:103: 00010000:00010000:0.0:1787692266.173524:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692266.173528:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09ddff9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09ddff2 expref: 11 pid: 5825 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173537:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09ddff9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09ddff2 expref: 11 pid: 5825 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173556:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173563:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173577:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173585:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173592:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173597:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173601:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d7a00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692266.173604:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173611:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173619:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.173629:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692266.173654:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+11:3305:x1874531125827200:12345-0@lo:103: Request processed in 138us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692266.173668:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787692266.173801:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125827200:0@lo:103: 00010000:00010000:1.0:1787692266.173943:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09ddff9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09ddff2 expref: 10 pid: 5825 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692266.173954:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125826816:0@lo:104: 00010000:00010000:1.0:1787692266.173974:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.173982:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.173988:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.174003:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec813d7a00/0x5d8b8560a09de0e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787692266.174016:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787692266.262363:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+9:6676:x1874531125826432:12345-0@lo:253: Request processed in 121742us (123648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692266.262379:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787692266.262493:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125826432:0@lo:253: 10000000:01000000:3.0:1787692266.262510:0:6676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787692266.262513:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787692266.262528:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787692266.262529:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692266.262531:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1787692266.262532:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692266.262534:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692266.262536:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692266.262537:0:6676:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787692266.262539:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692266.262541:0:6676:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787692266.262560:0:6676:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92ecafbbe800 from lustre-OST0000 10000000:01000000:3.0:1787692266.262587:0:6676:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787692266.262590:0:6676:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787692266.262598:0:6676:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92ec87fd3370 local copy 10000000:01000000:3.0:1787692266.262603:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787692266.262638:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.262649:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.262658:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692266.262677:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125827328:0@lo:101: 00000100:00100000:3.0:1787692266.262729:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692266.262850:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125827328 00000100:00100000:2.0:1787692266.262857:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125827328 00000100:00100000:2.0:1787692266.262894:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787692266.262903:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+9:6676:x1874531125827328:12345-0@lo:101: 00010000:00010000:2.0:1787692266.262916:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692266.262929:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09de0ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de0e7 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692266.262951:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09de0ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de0e7 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692266.262961:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09de0ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de0e7 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692266.262969:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3600, rc 0) 00000100:00100000:2.0:1787692266.263001:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+10:6676:x1874531125827328:12345-0@lo:101: Request processed in 100us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692266.263007:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787692266.263140:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec89cb1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787692266.263155:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125827328:0@lo:101: 00010000:00010000:3.0:1787692266.263167:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5d8b8560a09de0ee expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.263176:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d8b8560a09de0ee expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692266.263331:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125827456:0@lo:501: 00000100:00100000:3.0:1787692266.263360:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692266.263414:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125827456 00000100:00100000:2.0:1787692266.263419:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125827456 00000100:00100000:2.0:1787692266.263443:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787692266.263449:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+10:6676:x1874531125827456:12345-0@lo:501: 00000100:00100000:2.0:1787692266.263660:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+10:6676:x1874531125827456:12345-0@lo:501: Request processed in 210us (299us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787692266.263667:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787692266.265597:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec89cb1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787692266.265640:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125827456:0@lo:501: 10000000:01000000:3.0:1787692266.265666:0:6676:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787692266.266084:0:6676:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787692266.266095:0:6676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d8b8560a09de0ee expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.266107:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d8b8560a09de0ee expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.266115:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d8b8560a09de0ee expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.266143:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787692266.266171:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92ecafbbe800 10000000:01000000:3.0:1787692266.266178:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787692266.266183:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff92ec87fd3370 10000000:01000000:3.0:1787692266.266186:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787692266.266190:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff92ec87fd3370 from 1 10000000:01000000:3.0:1787692266.266193:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787692266.266314:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692266.266323:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5d8b8560a09de0ee expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.266331:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecc62cb200 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:1.0:1787692266.266335:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5d8b8560a09de0ee expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.266344:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5d8b8560a09de0ee expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787692266.266351:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5d8b8560a09de0ee expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692266.266357:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787692266.266381:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d8b8560a09de0ee expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.266388:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787692266.266453:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125827712:0@lo:103: 00000100:00100000:0.0:1787692266.266521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692266.266611:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125827712 00000100:00100000:2.0:1787692266.266617:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125827712 00000100:00100000:2.0:1787692266.266667:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787692266.266676:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+10:3306:x1874531125827712:12345-0@lo:103: 00010000:00010000:2.0:1787692266.266687:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692266.266715:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09de0ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de0e7 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692266.266734:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787692266.266858:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb000/0x5d8b8560a09de0f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.266867:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb000/0x5d8b8560a09de0f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.266895:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb000/0x5d8b8560a09de0f5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692266.266910:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125827584:0@lo:101: 00000100:00100000:3.0:1787692266.266941:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692266.266964:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec89cb1b40 going to sleep for 11 seconds 00010000:00010000:1.0:1787692266.268605:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d8b8560a09de0ee expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.268622:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de0e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d8b8560a09de0ee expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.268655:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692266.268668:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692266.268671:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692266.269107:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125827584 00000100:00100000:3.0:1787692266.269118:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125827584 00000100:00100000:3.0:1787692266.269171:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787692266.269183:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+10:6676:x1874531125827584:12345-0@lo:101: 00010000:00010000:3.0:1787692266.269197:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692266.269225:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecc62cbe00/0x5d8b8560a09de0fc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de0f5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.269258:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecc62cbe00/0x5d8b8560a09de0fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de0f5 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.269270:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecc62cbe00/0x5d8b8560a09de0fc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de0f5 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.269279:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecc62cbe00, rc 0) 00000100:00100000:3.0:1787692266.269353:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+11:6676:x1874531125827584:12345-0@lo:101: Request processed in 172us (2410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.269360:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787692266.269406:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125827584:0@lo:101: 00010000:00010000:3.0:1787692266.269424:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb000/0x5d8b8560a09de0f5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de0fc expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.269447:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb000/0x5d8b8560a09de0f5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de0fc expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692266.269469:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787692266.269480:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb000/0x5d8b8560a09de0f5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de0fc expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.269488:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb000/0x5d8b8560a09de0f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de0fc expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692266.269495:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787692266.269501:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787692266.269507:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787692266.269510:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787692266.269531:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.269539:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.269547:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692266.269565:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125827840:0@lo:101: 00000100:00100000:3.0:1787692266.269600:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692266.269623:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec89cb1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787692266.269650:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125827840 00000100:00100000:3.0:1787692266.269655:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125827840 00000100:00100000:3.0:1787692266.269680:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787692266.269686:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+11:6676:x1874531125827840:12345-0@lo:101: 00010000:00010000:3.0:1787692266.269693:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692266.270212:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de10a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de103 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.270234:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de103 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.270252:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de103 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.270260:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecc62cac00, rc 0) 00000100:00100000:3.0:1787692266.270302:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125827840:12345-0@lo:101: Request processed in 616us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.270310:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787692266.270344:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125827840:0@lo:101: 00010000:00010000:3.0:1787692266.270355:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de10a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.270364:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de10a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692266.270478:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125827968:0@lo:501: 00000100:00100000:3.0:1787692266.270506:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692266.270516:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec89cb1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787692266.270540:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125827968 00000100:00100000:3.0:1787692266.270544:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125827968 00000100:00100000:3.0:1787692266.270565:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787692266.270581:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125827968:12345-0@lo:501: 00000100:00100000:2.0:1787692266.270832:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+12:3306:x1874531125827712:12345-0@lo:103: Request processed in 4154us (4308us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.270875:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125827968:12345-0@lo:501: Request processed in 294us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.270883:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787692266.270909:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125827968:0@lo:501: 00000100:00100000:3.0:1787692266.270936:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828096:0@lo:503: 00000100:00100000:3.0:1787692266.270974:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692266.270984:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec89cb1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787692266.271004:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125828096 00000100:00100000:3.0:1787692266.271008:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125828096 00000100:00100000:3.0:1787692266.271025:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787692266.271031:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125828096:12345-0@lo:503: 00000100:00100000:3.0:1787692266.271180:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125828096:12345-0@lo:503: Request processed in 148us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.271187:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787692266.271194:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787692266.271224:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828096:0@lo:503: 00000040:00080000:3.0:1787692266.271520:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787692266.271573:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828224:0@lo:502: 00000100:00100000:3.0:1787692266.271609:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692266.271620:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec89c40540 going to sleep for 11 seconds 00000100:00100000:3.0:1787692266.271639:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125828224 00000100:00100000:3.0:1787692266.271643:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125828224 00000100:00100000:3.0:1787692266.271662:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787692266.271669:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+11:6676:x1874531125828224:12345-0@lo:502: 00000100:00100000:3.0:1787692266.271840:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+11:6676:x1874531125828224:12345-0@lo:502: Request processed in 170us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.271857:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787692266.271978:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828224:0@lo:502: 00000040:00080000:2.0:1787692266.272280:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787692266.272331:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787692266.272377:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787692266.272424:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787692266.272461:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787692266.272507:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787692266.272535:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828352:0@lo:502: 00000100:00100000:2.0:1787692266.272579:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692266.272614:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca8957d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787692266.278324:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125828352 00000100:00100000:3.0:1787692266.278342:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125828352 00000100:00100000:3.0:1787692266.278411:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787692266.278422:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+11:6676:x1874531125828352:12345-0@lo:502: 00000100:00100000:3.0:1787692266.278715:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+11:6676:x1874531125828352:12345-0@lo:502: Request processed in 294us (6133us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.278724:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787692266.280775:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828352:0@lo:502: 00000100:00100000:0.0:1787692266.281033:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125827712:0@lo:103: 00000040:00080000:2.0:1787692266.281063:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787692266.281082:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787692266.288079:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787692266.288094:0:6694:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787692266.288102:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692266.288105:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787692266.288111:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787692266.288140:0:6694:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff92ecaee5cd28) 00000020:00000080:3.0:1787692266.288163:0:6694:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787692266.288169:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787692266.288262:0:6694:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92ecafbbe800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787692266.288270:0:6694:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787692266.288277:0:6694:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d8b8560a09de118 00010000:00010000:3.0:1787692266.298788:0:6694:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787692266.299145:0:6694:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1787692266.304608:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1787692266.306045:0:6694:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787692266.320805:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787692266.321500:0:6694:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787692266.324151:0:6694:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787692266.324170:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787692266.324179:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692266.324181:0:6694:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787692266.324185:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787692266.324189:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692266.324190:0:6694:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787692266.324192:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787692266.324194:0:6694:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787692266.324289:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787692266.324293:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692266.324295:0:6694:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787692266.324298:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787692266.324788:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787692266.324837:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787692266.324853:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de10a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692266.324866:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de10a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692266.324875:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ecafbbe800 from 1 10000000:01000000:2.0:1787692266.324879:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787692266.324915:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692266.324925:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692266.324936:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692266.324961:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828480:0@lo:101: 00000100:00100000:2.0:1787692266.325048:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692266.325096:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca8957cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692266.325182:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125828480 00000100:00100000:0.0:1787692266.325190:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125828480 00000100:00100000:0.0:1787692266.325281:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787692266.325291:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+11:6676:x1874531125828480:12345-0@lo:101: 00010000:00010000:0.0:1787692266.325304:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692266.325317:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de126 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de11f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.325338:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de11f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.325359:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de11f expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.325368:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6424e00, rc 0) 00000100:00100000:0.0:1787692266.325427:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125828480:12345-0@lo:101: Request processed in 137us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692266.325434:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787692266.325615:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828480:0@lo:101: 00010000:00010000:2.0:1787692266.325629:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de126 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692266.325639:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de126 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692266.325753:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828608:0@lo:501: 00000100:00100000:2.0:1787692266.325781:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692266.333722:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125828608 00000100:00100000:3.0:1787692266.333736:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125828608 00000100:00100000:2.0:1787692266.333742:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca8957cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692266.333876:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787692266.333887:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125828608:12345-0@lo:501: 00000100:00100000:3.0:1787692266.334323:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125828608:12345-0@lo:501: Request processed in 437us (8540us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.334340:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787692266.334397:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828608:0@lo:501: 00000100:00100000:3.0:1787692266.334445:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828736:0@lo:503: 00000100:00100000:3.0:1787692266.334884:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692266.334910:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecbbf49900 going to sleep for 11 seconds 00000100:00100000:3.0:1787692266.334925:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125828736 00000100:00100000:3.0:1787692266.334929:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125828736 00000100:00100000:3.0:1787692266.334950:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787692266.334956:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125828736:12345-0@lo:503: 00000100:00100000:3.0:1787692266.335280:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125828736:12345-0@lo:503: Request processed in 323us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.335288:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787692266.335331:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828736:0@lo:503: 00000040:00080000:3.0:1787692266.336170:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787692266.336309:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828864:0@lo:502: 00000100:00100000:3.0:1787692266.336352:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692266.336419:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecbbf49900 going to sleep for 11 seconds 00000100:00100000:0.0:1787692266.336457:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125828864 00000100:00100000:0.0:1787692266.336461:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125828864 00000100:00100000:0.0:1787692266.336747:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787692266.336883:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125828864:12345-0@lo:502: 00000100:00100000:0.0:1787692266.337155:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125828864:12345-0@lo:502: Request processed in 400us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692266.337162:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787692266.337300:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828864:0@lo:502: 00000040:00080000:2.0:1787692266.337596:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1787692266.337650:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1787692266.337676:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828992:0@lo:502: 00000100:00100000:2.0:1787692266.339669:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692266.339761:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca89573c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692266.340098:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125828992 00000100:00100000:3.0:1787692266.340107:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125828992 00000100:00100000:3.0:1787692266.340185:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787692266.340196:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125828992:12345-0@lo:502: 00000100:00100000:3.0:1787692266.340497:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125828992:12345-0@lo:502: Request processed in 290us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.340506:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787692266.340523:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125828992:0@lo:502: 00000040:00080000:2.0:1787692266.340693:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787692266.340724:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787692266.343142:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787692266.343156:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692266.343159:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787692266.343166:0:6698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ecafbbe800 00000020:00000080:0.0:1787692266.343169:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787692266.343191:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787692266.343195:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692266.343196:0:6698:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787692266.343199:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787692266.344142:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787692266.344178:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787692266.344200:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de126 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.344222:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de126 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692266.344296:0:6676:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787692266.344300:0:6676:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92ecafbbe800 10000000:01000000:1.0:1787692266.344303:0:6676:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92ecafbbe800 10000000:01000000:1.0:1787692266.344308:0:6676:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787692266.344314:0:6676:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ecafbbe800 from 1 10000000:01000000:1.0:1787692266.344317:0:6676:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787692266.344352:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.344360:0:6676:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.344371:0:6676:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692266.344394:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125829120:0@lo:101: 00000100:00100000:1.0:1787692266.344479:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692266.344529:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90a38780 going to sleep for 11 seconds 00000100:00100000:0.0:1787692266.345094:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125829120 00000100:00100000:0.0:1787692266.345101:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125829120 00000100:00100000:0.0:1787692266.345151:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787692266.345161:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125829120:12345-0@lo:101: 00010000:00010000:0.0:1787692266.345176:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692266.345196:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de134 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de12d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.345234:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de12d expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.345254:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de12d expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692266.345262:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425c00, rc 0) 00000100:00100000:0.0:1787692266.345311:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:6676:x1874531125829120:12345-0@lo:101: Request processed in 151us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692266.345318:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787692266.345457:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125829120:0@lo:101: 00010000:00010000:1.0:1787692266.345474:0:6676:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de134 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.345501:0:6676:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de134 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692266.345612:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125829248:0@lo:501: 00000100:00100000:1.0:1787692266.345974:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692266.346008:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90a38780 going to sleep for 11 seconds 00000100:00100000:0.0:1787692266.346050:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125829248 00000100:00100000:0.0:1787692266.346055:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125829248 00000100:00100000:0.0:1787692266.346090:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787692266.346098:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:6676:x1874531125829248:12345-0@lo:501: 00000100:00100000:0.0:1787692266.346396:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:6676:x1874531125829248:12345-0@lo:501: Request processed in 298us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692266.346403:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787692266.346844:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125829248:0@lo:501: 00000100:00100000:2.0:1787692266.346887:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125829376:0@lo:503: 00000100:00100000:2.0:1787692266.346939:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692266.347026:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125829376 00000100:00100000:0.0:1787692266.347031:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125829376 00000100:00100000:0.0:1787692266.347073:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787692266.347083:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:6676:x1874531125829376:12345-0@lo:503: 00000100:00100000:0.0:1787692266.347269:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:6676:x1874531125829376:12345-0@lo:503: Request processed in 187us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692266.347276:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787692266.347318:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca89573c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692266.347333:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125829376:0@lo:503: 00000040:00080000:0.0:1787692266.347678:0:6676:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787692266.347750:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125829504:0@lo:502: 00000100:00100000:0.0:1787692266.347787:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692266.347844:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9020c300 going to sleep for 11 seconds 00000100:00100000:1.0:1787692266.347868:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125829504 00000100:00100000:1.0:1787692266.347873:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125829504 00000100:00100000:1.0:1787692266.347908:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787692266.347916:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:6676:x1874531125829504:12345-0@lo:502: 00000100:00100000:1.0:1787692266.348119:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:6676:x1874531125829504:12345-0@lo:502: Request processed in 204us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692266.348127:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787692266.348284:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125829504:0@lo:502: 00000040:00080000:0.0:1787692266.348546:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787692266.348595:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787692266.348632:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787692266.348680:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787692266.348735:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787692266.348787:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787692266.348861:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787692266.348901:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787692266.348948:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787692266.348981:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787692266.349015:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787692266.349080:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787692266.349119:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787692266.349150:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787692266.349197:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787692266.349237:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787692266.349283:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787692266.349328:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787692266.349366:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787692266.349404:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787692266.349451:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787692266.349486:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787692266.349519:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787692266.349566:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787692266.349601:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787692266.349655:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787692266.349706:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787692266.349745:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1787692266.349781:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125829632:0@lo:502: 00000100:00100000:0.0:1787692266.349881:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692266.349915:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9020c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787692266.350048:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125829632 00000100:00100000:2.0:1787692266.350054:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125829632 00000100:00100000:2.0:1787692266.350102:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787692266.350110:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+13:6676:x1874531125829632:12345-0@lo:502: 00000100:00100000:2.0:1787692266.350341:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+13:6676:x1874531125829632:12345-0@lo:502: Request processed in 230us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692266.350348:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787692266.350804:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125829632:0@lo:502: 00000040:00080000:1.0:1787692266.350944:0:6676:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787692266.350956:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787692266.353711:0:6699:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787692266.353747:0:6699:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff92eb85143370) 00000020:00000080:1.0:1787692266.353767:0:6699:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787692266.353928:0:6699:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92ecafbbe800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787692266.353933:0:6699:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92ecafbbe800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787692266.353936:0:6699:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ecafbbe800 3 00010000:00080000:1.0:1787692266.353969:0:6699:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92eb8514f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.127@tcp at head 00010000:00010000:1.0:1787692266.360061:0:6699:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787692266.360286:0:6699:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787692266.360326:0:6699:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787692266.360347:0:6699:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5d8b8560a09de142 00000100:00080000:1.0:1787692266.360359:0:6699:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787692266.360366:0:6699:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92eb8514f000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1787692266.360401:0:6699:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecafba3480 x1874531125829760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787692266.360426:0:6699:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787692266.360627:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125829888:0@lo:400: 00000100:00100000:3.0:1787692266.360777:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1787692266.360988:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787692266.361056:0:6676:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787692266.361081:0:6676:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787692266.361102:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de134 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692266.361112:0:6676:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de134 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787692266.361156:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787692266.361159:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787692266.361160:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692266.361162:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692266.361163:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692266.361164:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692266.361166:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692266.361167:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787692266.361169:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787692266.361170:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692266.361172:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787692266.361175:0:6676:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787692266.361178:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787692266.361179:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787692266.361180:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692266.361181:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692266.361182:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692266.361183:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692266.361185:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692266.361186:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787692266.361187:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787692266.361188:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692266.361189:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787692266.361287:0:6676:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787692266.361300:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125830016:0@lo:253: 00000100:00100000:3.0:1787692266.361347:0:6676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692266.361390:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecbbf490c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692266.361473:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125830016 00000100:00100000:1.0:1787692266.361480:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125830016 00000100:00100000:1.0:1787692266.361593:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787692266.361603:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:6676:x1874531125830016:12345-0@lo:253: 20000000:01000000:1.0:1787692266.362081:0:5823:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787692266.362094:0:5823:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787692266.363417:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874531125829760:0@lo:38: 00000100:00100000:0.0:1787692266.363496:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692266.363550:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125829888 00000100:00100000:3.0:1787692266.363558:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125829888 00000100:00100000:0.0:1787692266.363577:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125829760 00000100:00100000:0.0:1787692266.363583:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125829760 00000100:00100000:3.0:1787692266.363603:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787692266.363611:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787692266.363615:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125829888:12345-0@lo:400: 00000100:00100000:0.0:1787692266.363623:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874531125829760:12345-0@lo:38: 00010000:00080000:0.0:1787692266.363648:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1787692266.363685:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5d8b8560a09de149 00000004:00100000:0.0:1787692266.363700:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787692266.363733:0:5833:0:(import.c:65:import_set_state_nolock()) ffff92eb84e1a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787692266.363778:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874531125829760:12345-0@lo:38: Request processed in 157us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692266.363785:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787692266.364187:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125829888:12345-0@lo:400: Request processed in 575us (3409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692266.364194:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787692266.364306:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92ecae9fce00 x1874531125829888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692266.364321:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125829888:0@lo:400: 00010000:00080000:1.0:1787692266.366955:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92ecafba3480 x1874531125829760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787692276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692266.366971:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787692266.366980:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787692266.366999:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787692266.367004:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787692266.367008:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92eb8514f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787692266.367016:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874531125829760:0@lo:38: 20000000:01000000:2.0:1787692266.467431:0:5823:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787692266.467452:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1787692266.467523:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1787692266.467529:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1787692266.467553:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.467572:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de0af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de0a8 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.467597:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.467643:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de0a8 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.467657:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de0af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de0a8 expref: 13 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692266.467672:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874531125830144:0@lo:104: 00000100:00100000:1.0:1787692266.467742:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692266.467790:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90326cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692266.467831:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125830144 00000100:00100000:1.0:1787692266.467837:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125830144 00000100:00100000:1.0:1787692266.467882:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787692266.467892:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+3:5847:x1874531125830144:12345-0@lo:104: 00010000:00010000:1.0:1787692266.467904:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec80031000/0x5d8b8560a09de0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de0af expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.467962:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787692266.467968:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+3:5847:x1874531125830144:12345-0@lo:104: Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692266.467975:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787692266.467998:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692266.468004:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec80031000/0x5d8b8560a09de0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de0af expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468012:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031000 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:1.0:1787692266.468023:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec80031000/0x5d8b8560a09de0a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de0af expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468032:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec80031000/0x5d8b8560a09de0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de0af expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692266.468037:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874531125830144:0@lo:104: 10000000:00010000:1.0:1787692266.468041:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec80031000/0x5d8b8560a09de0a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de0af expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692266.468050:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787692266.468059:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468080:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec80031000/0x5d8b8560a09de0a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de0af expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468088:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787692266.468118:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec80031000/0x5d8b8560a09de0a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de0af expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468125:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec80031000/0x5d8b8560a09de0a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de0af expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468142:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692266.468144:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692266.468146:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692266.468162:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787692266.468171:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125830272:0@lo:103: 00000100:00100000:1.0:1787692266.468204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692266.468323:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125830272 00000100:00100000:1.0:1787692266.468328:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125830272 00010000:00010000:1.0:1787692266.468346:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de0af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de0a8 expref: 14 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692266.468367:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787692266.468380:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+14:3305:x1874531125830272:12345-0@lo:103: 00010000:00010000:1.0:1787692266.468391:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692266.468396:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de0af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de0a8 expref: 14 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468406:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de0af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de0a8 expref: 14 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468419:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de0af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de0a8 expref: 14 pid: 5826 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468430:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468438:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787692266.468450:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004802226s 00010000:00010000:1.0:1787692266.468454:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468461:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468467:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468474:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468480:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d6200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692266.468489:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468496:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468510:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468518:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692266.468548:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+13:3305:x1874531125830272:12345-0@lo:103: Request processed in 169us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692266.468554:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787692266.468606:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125830272:0@lo:103: 00010000:00010000:1.0:1787692266.468621:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468628:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692266.468634:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec813d6200/0x5d8b8560a09de150 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692266.478273:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:6676:x1874531125830016:12345-0@lo:253: Request processed in 116660us (116913us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692266.478289:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787692266.478404:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:6676:1874531125830016:0@lo:253: 10000000:01000000:3.0:1787692266.478419:0:6676:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787692266.478422:0:6676:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787692266.478424:0:6676:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787692266.478426:0:6676:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692266.478427:0:6676:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692266.478428:0:6676:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692266.478430:0:6676:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692266.478431:0:6676:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692266.478433:0:6676:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787692266.478434:0:6676:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787692266.478436:0:6676:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692266.478437:0:6676:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787692266.478452:0:6676:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787692266.494141:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787692266.494759:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787692266.495042:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787692266.497548:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787692266.498131:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787692266.504937:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787692266.506673:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787692266.694151:0:6676:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1787692266.694160:0:6676:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787692266.694192:0:6676:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787692266.694268:0:6676:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.127@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787692266.694311:0:6676:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787692266.694336:0:6676:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787692267.010327:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692268.033089:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787692268.675598:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787692268.675615:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ec9dbcc000 from 21 10000000:01000000:3.0:1787692268.675621:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787692268.675663:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692268.675675:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692268.675687:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692268.675710:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125830400:0@lo:101: 00000100:00100000:3.0:1787692268.675784:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692268.675857:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec942326c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692268.676021:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125830400 00000100:00100000:2.0:1787692268.676029:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125830400 00000100:00100000:2.0:1787692268.676073:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787692268.676082:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+12:5828:x1874531125830400:12345-0@lo:101: 00010000:00010000:2.0:1787692268.676094:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692268.676107:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de15e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de157 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692268.676130:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de157 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692268.676151:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de157 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692268.676160:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3200, rc 0) 00000100:00100000:2.0:1787692268.676215:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:5828:x1874531125830400:12345-0@lo:101: Request processed in 135us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692268.676222:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787692268.676276:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125830400:0@lo:101: 00010000:00010000:2.0:1787692268.676290:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de15e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692268.676298:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de15e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692268.676348:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125830528:0@lo:501: 00000100:00100000:2.0:1787692268.676373:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692268.676389:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787692268.676401:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125830528 00000100:00100000:2.0:1787692268.676405:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125830528 00000100:00100000:2.0:1787692268.676425:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787692268.676431:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:5828:x1874531125830528:12345-0@lo:501: 00000100:00100000:2.0:1787692268.676787:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:5828:x1874531125830528:12345-0@lo:501: Request processed in 354us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692268.676793:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787692268.676852:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125830528:0@lo:501: 00000100:00100000:2.0:1787692268.676892:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125830656:0@lo:503: 00000100:00100000:2.0:1787692268.676937:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692268.676951:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6480 going to sleep for 11 seconds 00000100:00100000:2.0:1787692268.676962:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125830656 00000100:00100000:2.0:1787692268.676965:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125830656 00000100:00100000:2.0:1787692268.676986:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787692268.676993:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:5828:x1874531125830656:12345-0@lo:503: 00000100:00100000:2.0:1787692268.677288:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:5828:x1874531125830656:12345-0@lo:503: Request processed in 294us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692268.677295:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787692268.677338:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125830656:0@lo:503: 00000100:00100000:3.0:1787692268.678164:0:6803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:6803:1874531125830784:0@lo:502: 00000100:00100000:3.0:1787692268.678234:0:6803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692268.678268:0:6803:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec94232600 going to sleep for 11 seconds 00000100:00100000:1.0:1787692268.678366:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125830784 00000100:00100000:1.0:1787692268.678372:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125830784 00000100:00100000:1.0:1787692268.678419:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787692268.678428:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:6803:x1874531125830784:12345-0@lo:502: 00000100:00100000:1.0:1787692268.678691:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:6803:x1874531125830784:12345-0@lo:502: Request processed in 263us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692268.678698:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787692268.678776:0:6803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:6803:1874531125830784:0@lo:502: 00000100:00100000:3.0:1787692268.678849:0:6803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:6803:1874531125830912:0@lo:502: 00000100:00100000:3.0:1787692268.678996:0:6803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692268.679782:0:6803:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec94232600 going to sleep for 11 seconds 00000100:00100000:1.0:1787692268.682063:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125830912 00000100:00100000:1.0:1787692268.682077:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125830912 00000100:00100000:1.0:1787692268.682319:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787692268.682330:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+13:6803:x1874531125830912:12345-0@lo:502: 00000100:00100000:1.0:1787692268.682635:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+13:6803:x1874531125830912:12345-0@lo:502: Request processed in 306us (3637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692268.682642:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787692268.682726:0:6803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:6803:1874531125830912:0@lo:502: 00000040:00080000:3.0:1787692268.682764:0:6803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787692268.683442:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787692268.683469:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787692268.683478:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de15e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692268.683490:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de15e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692268.683501:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787692268.683504:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92ec9dbcc000 from 4 10000000:01000000:1.0:1787692268.683507:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787692268.683542:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692268.683550:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692268.683571:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692268.683590:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125831040:0@lo:101: 00000100:00100000:1.0:1787692268.683634:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692268.683674:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec876af300 going to sleep for 11 seconds 00000100:00100000:2.0:1787692268.683723:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125831040 00000100:00100000:2.0:1787692268.683729:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125831040 00000100:00100000:2.0:1787692268.683768:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787692268.683777:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:5828:x1874531125831040:12345-0@lo:101: 00010000:00010000:2.0:1787692268.683788:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692268.683801:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de16c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de165 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692268.684052:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de16c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de165 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692268.684064:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de16c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de165 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692268.684073:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2600, rc 0) 00000100:00100000:2.0:1787692268.684119:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125831040:12345-0@lo:101: Request processed in 343us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692268.684136:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787692268.684274:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125831040:0@lo:101: 00010000:00010000:1.0:1787692268.684286:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de16c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692268.684295:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de16c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692268.684342:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125831168:0@lo:256: 00000100:00100000:1.0:1787692268.684372:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692268.684433:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec876af300 going to sleep for 11 seconds 00000100:00100000:2.0:1787692268.690330:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125831168 00000100:00100000:2.0:1787692268.690345:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125831168 00000100:00100000:2.0:1787692268.690399:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787692268.690409:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125831168:12345-0@lo:256: 20000000:01000000:2.0:1787692268.690434:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787692268.690450:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787692268.690453:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787692268.690582:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125831168:12345-0@lo:256: Request processed in 174us (6208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692268.690590:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787692268.690644:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125831168:0@lo:256: 10000000:01000000:2.0:1787692268.690696:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787692268.690705:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de16c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692268.690715:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de16c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692268.690724:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787692268.690726:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787692268.690729:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787692268.690754:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692268.690761:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692268.690780:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692268.690797:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125831296:0@lo:101: 00000100:00100000:2.0:1787692268.690851:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692268.690876:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787692268.691361:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125831296 00000100:00100000:1.0:1787692268.691368:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125831296 00000100:00100000:1.0:1787692268.691470:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787692268.691479:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125831296:12345-0@lo:101: 00010000:00010000:1.0:1787692268.691490:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692268.691504:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec813d6400/0x5d8b8560a09de17a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de173 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692268.691526:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec813d6400/0x5d8b8560a09de17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de173 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692268.691548:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec813d6400/0x5d8b8560a09de17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de173 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692268.691556:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec813d6400, rc 0) 00000100:00100000:1.0:1787692268.691596:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125831296:12345-0@lo:101: Request processed in 119us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692268.691603:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787692268.701321:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125831296:0@lo:101: 00010000:00010000:2.0:1787692268.701352:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de17a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692268.701365:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de17a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692268.701445:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125831424:0@lo:501: 00000100:00100000:2.0:1787692268.706143:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692268.706220:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787692268.706372:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125831424 00000100:00100000:1.0:1787692268.706381:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125831424 00000100:00100000:1.0:1787692268.706458:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787692268.706469:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125831424:12345-0@lo:501: 00000100:00100000:1.0:1787692268.708993:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125831424:12345-0@lo:501: Request processed in 2519us (2851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692268.709007:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787692268.709244:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125831424:0@lo:501: 00000100:00100000:2.0:1787692268.709294:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125831552:0@lo:503: 00000100:00100000:2.0:1787692268.709345:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692268.709380:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6180 going to sleep for 11 seconds 00000100:00100000:1.0:1787692268.709484:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125831552 00000100:00100000:1.0:1787692268.709491:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125831552 00000100:00100000:1.0:1787692268.709534:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787692268.709543:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125831552:12345-0@lo:503: 00000100:00100000:0.0:1787692268.713325:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125831552:12345-0@lo:503: Request processed in 3773us (3969us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692268.713342:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787692268.715049:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125831552:0@lo:503: 00000100:00100000:0.0:1787692268.716843:0:6807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:6807:1874531125831680:0@lo:502: 00000100:00100000:0.0:1787692268.716935:0:6807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692268.716975:0:6807:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec880cb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692268.717087:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125831680 00000100:00100000:3.0:1787692268.717094:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125831680 00000100:00100000:3.0:1787692268.717135:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787692268.717145:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+15:6807:x1874531125831680:12345-0@lo:502: 00000100:00100000:3.0:1787692268.717482:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+15:6807:x1874531125831680:12345-0@lo:502: Request processed in 337us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692268.717496:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787692268.717640:0:6807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:6807:1874531125831680:0@lo:502: 00000020:01000000:0.0:1787692268.717670:0:6807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787692268.717682:0:6807:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787692268.717691:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692268.717693:0:6807:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787692268.717700:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787692268.717704:0:6807:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.127@tcp to nid 0x20000c0a8ce7f (192.168.206.127@tcp) 00000020:01000000:0.0:1787692268.717728:0:6807:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787692268.717731:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787692268.717745:0:6807:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff92ec87e68000) 00000020:00000080:0.0:1787692268.717764:0:6807:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787692268.717771:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787692268.717873:0:6807:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787692268.717888:0:6807:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787692268.717895:0:6807:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09de188 00010000:00080000:0.0:1787692268.717936:0:6807:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92ecaec5a800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.127@tcp at head 00010000:00010000:0.0:1787692268.718182:0:6807:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787692268.800169:0:6807:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787692268.800429:0:6807:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787692268.803553:0:6807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787692268.803753:0:6807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787692268.803805:0:6807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787692268.803908:0:6807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1787692268.813427:0:6815:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787692268.813436:0:6815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787692268.829792:0:6807:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787692268.829835:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787692268.829873:0:6807:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787692268.831174:0:6807:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d8b8560a09de18f 00000100:00080000:3.0:1787692268.831189:0:6807:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787692268.831270:0:6807:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92ecaec5a800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:3.0:1787692268.831306:0:6807:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecae9fce00 x1874531125831808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787692268.831332:0:6807:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787692268.831406:0:6807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787692268.831412:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692268.831414:0:6807:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787692268.831417:0:6807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787692268.831421:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692268.831422:0:6807:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787692268.831425:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787692268.831427:0:6807:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787692268.831452:0:6807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:6807:1874531125831936:0@lo:502: 00000100:00100000:3.0:1787692268.831524:0:6807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692268.831568:0:6807:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec94232240 going to sleep for 11 seconds 00000100:00100000:3.0:1787692268.831590:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125831808:0@lo:8: 00000100:00100000:3.0:1787692268.831618:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692268.831649:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125831808 00000100:00100000:3.0:1787692268.831655:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125831808 00000100:00100000:3.0:1787692268.831680:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787692268.831686:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874531125831808:12345-0@lo:8: 00010000:00080000:3.0:1787692268.831707:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:3.0:1787692268.831734:0:6679:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d8b8560a09de196 00002000:00100000:3.0:1787692268.831767:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff92eb850d0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787692268.831771:0:6679:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1787692268.831774:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1787692268.832095:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125832064:0@lo:400: 00000100:00100000:1.0:1787692268.832168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692268.832303:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125831936 00000100:00100000:0.0:1787692268.832309:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125831936 00000100:00100000:0.0:1787692268.832346:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787692268.832354:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+15:6807:x1874531125831936:12345-0@lo:502: 00000100:00100000:0.0:1787692268.832593:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+15:6807:x1874531125831936:12345-0@lo:502: Request processed in 239us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692268.832600:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787692268.832643:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125832192:0@lo:400: 00000100:00100000:0.0:1787692268.832670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692268.832707:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125832064 00000100:00100000:0.0:1787692268.832711:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125832064 00000100:00100000:0.0:1787692268.832734:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125832192 00000100:00100000:0.0:1787692268.832736:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125832192 00000100:00100000:0.0:1787692268.832762:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787692268.832768:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125832064:12345-0@lo:400: 00002000:00100000:3.0:1787692268.833354:0:6679:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787692268.833526:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787692268.833552:0:6679:0:(import.c:65:import_set_state_nolock()) ffff92eb850d3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787692268.834579:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874531125831808:12345-0@lo:8: Request processed in 2886us (2954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692268.834591:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787692268.834640:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692268.834934:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125832064:12345-0@lo:400: Request processed in 2164us (2763us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692268.834944:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787692268.834966:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787692268.834977:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125832192:12345-0@lo:400: 00000100:00100000:0.0:1787692268.835034:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125832192:12345-0@lo:400: Request processed in 61us (2363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692268.835041:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787692268.835080:0:6807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:6807:1874531125831936:0@lo:502: 00000020:01000000:0.0:1787692268.835128:0:6807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787692268.835136:0:6807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692268.835138:0:6807:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787692268.835143:0:6807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00010000:00080000:2.0:1787692268.835314:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecae9fce00 x1874531125831808/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787692278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692268.835336:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00080000:0.0:1787692268.835339:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec88aa2a00 x1874531125832064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787692268.835344:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00100000:0.0:1787692268.835348:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125832064:0@lo:400: 00000100:00080000:2.0:1787692268.835352:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787692268.835357:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787692268.835360:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ecaec5a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787692268.835372:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00010000:00080000:0.0:1787692268.835374:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec88aa2d80 x1874531125832192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692268.835377:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125831808:0@lo:8: 00000100:00100000:0.0:1787692268.835384:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125832192:0@lo:400: 00000004:00080000:2.0:1787692268.835429:0:6815:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787692268.835712:0:6815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 175041898533ns, next at 0ns, rc = 0 00000020:01000000:3.0:1787692268.836396:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1787692268.836421:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787692268.836432:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de17a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692268.836443:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de17a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692268.836453:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787692268.836456:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92ec87fd3370 from 1 10000000:01000000:3.0:1787692268.836459:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787692268.836490:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692268.836498:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692268.836507:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692268.836535:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125832320:0@lo:101: 00000100:00100000:3.0:1787692268.836588:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692268.836626:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec94232e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787692268.836645:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125832320 00000100:00100000:3.0:1787692268.836652:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125832320 00000100:00100000:3.0:1787692268.836697:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787692268.836704:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125832320:12345-0@lo:101: 00010000:00010000:3.0:1787692268.836715:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692268.836726:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de1a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de19d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692268.836746:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de19d expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692268.836756:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de19d expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692268.836765:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecc62cba00, rc 0) 00000100:00100000:3.0:1787692268.836797:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125832320:12345-0@lo:101: Request processed in 93us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692268.836804:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787692268.836857:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125832320:0@lo:101: 00010000:00010000:3.0:1787692268.836870:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de1a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692268.837981:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de1a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692268.838062:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125832448:0@lo:501: 00000100:00100000:3.0:1787692268.838109:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692268.838142:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec94232e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787692268.838318:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125832448 00000100:00100000:2.0:1787692268.838324:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125832448 00000100:00100000:2.0:1787692268.838364:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787692268.838372:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125832448:12345-0@lo:501: 00000100:00100000:2.0:1787692268.838578:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125832448:12345-0@lo:501: Request processed in 206us (467us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787692268.838586:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787692268.839001:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125832448:0@lo:501: 10000000:01000000:3.0:1787692268.839029:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787692268.839037:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de1a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692268.839046:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de1a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787692268.903400:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1787692268.927091:0:6816:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787692268.927128:0:6816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1874531125832704:0@lo:7: 00000100:00100000:2.0:1787692268.927218:0:6816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692268.927281:0:6816:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787692268.927310:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787692268.927321:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125832576:0@lo:13: 00000100:00100000:2.0:1787692268.927348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692268.927384:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125832704 00000100:00100000:2.0:1787692268.927391:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125832704 00000100:00100000:2.0:1787692268.927451:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787692268.927459:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6816:x1874531125832704:12345-0@lo:7: 00000100:00100000:0.0:1787692268.929120:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125832576 00000100:00100000:0.0:1787692268.929137:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125832576 00000100:00100000:0.0:1787692268.929248:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787692268.929259:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874531125832576:12345-0@lo:13: 00002000:00000024:0.0:1787692268.929288:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787692268.929377:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874531125832576:12345-0@lo:13: Request processed in 120us (2027us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692268.929384:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787692268.929455:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec88aa2680 x1874531125832576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692268.929478:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125832576:0@lo:13: 00000100:00080000:3.0:1787692268.929932:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1787692268.961489:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787692268.961499:0:6681:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787692268.965546:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6816:x1874531125832704:12345-0@lo:7: Request processed in 38067us (38308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692268.965570:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787692268.965794:0:6816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec88aa3100 x1874531125832704/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787692284 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692268.965835:0:6816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1874531125832704:0@lo:7: 00000004:00080000:2.0:1787692268.965870:0:6816:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787692268.965919:0:6816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1874531125832832:0@lo:5: 00000100:00100000:2.0:1787692268.965972:0:6816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692268.966023:0:6816:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787692268.966095:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125832832 00000100:00100000:3.0:1787692268.966103:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125832832 00000100:00100000:3.0:1787692268.966146:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787692268.966155:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6816:x1874531125832832:12345-0@lo:5: 00002000:00080000:3.0:1787692268.966181:0:6680:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787692268.966185:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787692268.966540:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6816:x1874531125832832:12345-0@lo:5: Request processed in 385us (566us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787692268.966547:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787692268.967184:0:6816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec88aa3100 x1874531125832832/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787692284 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692268.967201:0:6816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1874531125832832:0@lo:5: 00000004:00080000:2.0:1787692268.967212:0:6816:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787692268.967253:0:6816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1874531125832960:0@lo:700: 00000100:00100000:2.0:1787692268.967291:0:6816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692268.967320:0:6816:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787692268.967516:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125832960 00000100:00100000:1.0:1787692268.967522:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125832960 00000100:00100000:1.0:1787692268.967581:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787692268.967588:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6816:x1874531125832960:12345-0@lo:700: 00000100:00100000:1.0:1787692268.967632:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6687:1874531125833088:0@lo:700: 00000100:00100000:1.0:1787692268.967663:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692268.967685:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec876af300 going to sleep for 11 seconds 00000100:00100000:0.0:1787692268.967796:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125833088 00000100:00100000:0.0:1787692268.967801:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125833088 00000100:00100000:0.0:1787692268.967870:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787692268.967887:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6687:x1874531125833088:12345-0@lo:700: 40000000:02000000:2.0:1787692269.040994:0:5838:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787692269.049741:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6687:x1874531125833088:12345-0@lo:700: Request processed in 81856us (82069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692269.049761:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787692269.054364:0:6687:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecafba3100 x1874531125833088/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787692284 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692269.054384:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba3100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6687:1874531125833088:0@lo:700: 40000000:02000000:1.0:1787692269.054398:0:6687:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:0.0:1787692269.062897:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692269.160482:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6816:x1874531125832960:12345-0@lo:700: Request processed in 192884us (193180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692269.160497:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:1.0:1787692269.160542:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1787692269.160552:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1787692269.162117:0:6816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec88aa0000 x1874531125832960/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787692284 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692269.162140:0:6816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1874531125832960:0@lo:700: 00000004:02000040:0.0:1787692269.222608:0:6816:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787692269.229372:0:6816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1874531125833216:0@lo:5: 00000100:00100000:1.0:1787692269.229441:0:6816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692269.230064:0:6816:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec94232600 going to sleep for 11 seconds 00000100:00100000:0.0:1787692269.230292:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125833216 00000100:00100000:0.0:1787692269.230300:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125833216 00000100:00100000:0.0:1787692269.230359:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787692269.230368:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6816:x1874531125833216:12345-0@lo:5: 00002000:00080000:1.0:1787692269.236028:0:6681:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787692269.236049:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787692269.239571:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6816:x1874531125833216:12345-0@lo:5: Request processed in 9197us (10122us total) trans 4294967298 rc 0/0 00010000:00080000:1.0:1787692269.239582:0:6816:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecafba3100 x1874531125833216/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787692285 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692269.239584:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787692269.239595:0:6816:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787692269.239608:0:6816:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff92ecafba3100 x1874531125833216/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787692285 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692269.239619:0:6816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6816:1874531125833216:0@lo:5: 00000004:00080000:1.0:1787692269.239633:0:6816:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787692270.081087:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692271.106898:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692272.129267:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787692273.043150:0:7046:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787692273.152923:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692273.986130:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125833472:0@lo:400: 00000100:00100000:0.0:1787692273.986227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692273.986279:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787692273.986285:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125833344:0@lo:400: 00000100:00100000:0.0:1787692273.986313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692273.986345:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125833600:0@lo:400: 00000100:00100000:0.0:1787692273.986368:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692273.986386:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692273.986391:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125833728:0@lo:400: 00000100:00100000:0.0:1787692273.986419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692273.986447:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125833472 00000100:00100000:0.0:1787692273.986453:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125833472 00000100:00100000:0.0:1787692273.986492:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125833600 00000100:00100000:0.0:1787692273.986495:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125833600 00000100:00100000:0.0:1787692273.986521:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787692273.986529:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125833472:12345-0@lo:400: 00000100:00100000:0.0:1787692273.986578:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125833472:12345-0@lo:400: Request processed in 49us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692273.986585:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787692273.986602:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787692273.986608:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125833600:12345-0@lo:400: 00000100:00100000:0.0:1787692273.986637:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125833600:12345-0@lo:400: Request processed in 29us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692273.986642:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787692273.986658:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125833344 00000100:00100000:0.0:1787692273.986661:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125833344 00000100:00100000:0.0:1787692273.986683:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787692273.986689:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:3305:x1874531125833344:12345-0@lo:400: 00000100:00100000:0.0:1787692273.986726:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:3305:x1874531125833344:12345-0@lo:400: Request processed in 37us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692273.986732:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787692273.986761:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125833728 00000100:00100000:0.0:1787692273.986765:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125833728 00000100:00100000:0.0:1787692273.986793:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787692273.986799:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874531125833728:12345-0@lo:400: 00000100:00100000:0.0:1787692273.986854:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874531125833728:12345-0@lo:400: Request processed in 56us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692273.986861:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1787692273.986879:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787692273.986884:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787692273.986915:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecafba5500 x1874531125833728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692273.986931:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125833728:0@lo:400: 00010000:00080000:0.0:1787692273.986941:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecafba5880 x1874531125833600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692273.986949:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125833600:0@lo:400: 00000100:00100000:0.0:1787692273.986972:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125833344:0@lo:400: 00010000:00080000:0.0:1787692273.986982:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecafba7b80 x1874531125833472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692273.986990:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125833472:0@lo:400: 00000100:00100000:1.0:1787692273.990094:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787692273.990123:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125833856:0@lo:13: 00000100:00100000:1.0:1787692273.990211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692273.991298:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125833856 00000100:00100000:2.0:1787692273.991313:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125833856 00000100:00100000:2.0:1787692273.991365:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787692273.991374:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874531125833856:12345-0@lo:13: 00002000:00000024:2.0:1787692273.991409:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692273.991470:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874531125833856:12345-0@lo:13: Request processed in 98us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692273.991477:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787692273.992029:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec88aa0000 x1874531125833856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692273.992050:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125833856:0@lo:13: 00010000:00010000:1.0:1787692274.185877:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787692274.600061:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1787692275.200985:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692276.228922:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692277.250952:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692278.276877:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692279.105211:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125834368:0@lo:400: 00000100:00100000:3.0:1787692279.105283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692279.105372:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787692279.105380:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125833984:0@lo:400: 00000100:00100000:3.0:1787692279.105431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692279.105473:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125834112:0@lo:400: 00000100:00100000:3.0:1787692279.105517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692279.105541:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692279.105548:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125834240:0@lo:400: 00000100:00100000:3.0:1787692279.105576:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692279.105606:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125833984 00000100:00100000:3.0:1787692279.105613:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125833984 00000100:00100000:3.0:1787692279.105653:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787692279.105660:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+16:3304:x1874531125833984:12345-0@lo:400: 00000100:00100000:3.0:1787692279.105707:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+16:3304:x1874531125833984:12345-0@lo:400: Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692279.105714:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787692279.105744:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125834112 00000100:00100000:3.0:1787692279.105748:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125834112 00000100:00100000:3.0:1787692279.105772:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125834240 00000100:00100000:3.0:1787692279.105775:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125834240 00000100:00100000:3.0:1787692279.105798:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787692279.105805:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125834112:12345-0@lo:400: 00000100:00100000:3.0:1787692279.105887:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125834112:12345-0@lo:400: Request processed in 80us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692279.105895:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787692279.105914:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787692279.105922:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125834240:12345-0@lo:400: 00000100:00100000:3.0:1787692279.105952:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125834240:12345-0@lo:400: Request processed in 32us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692279.105965:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787692279.105987:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692279.106016:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125833984:0@lo:400: 00010000:00080000:3.0:1787692279.106017:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecae9fe300 x1874531125834240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692279.106034:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125834240:0@lo:400: 00010000:00080000:3.0:1787692279.106047:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecae9ff800 x1874531125834112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692279.106056:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125834112:0@lo:400: 00000100:00100000:0.0:1787692279.106312:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125834368 00000100:00100000:0.0:1787692279.106317:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125834368 00000100:00100000:0.0:1787692279.106378:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787692279.106386:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125834368:12345-0@lo:400: 00000100:00100000:0.0:1787692279.106442:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125834368:12345-0@lo:400: Request processed in 58us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692279.106449:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787692279.106762:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecae9fca80 x1874531125834368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692279.106773:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787692279.106784:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125834368:0@lo:400: 00000100:00100000:1.0:1787692279.106796:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787692279.106802:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125834496:0@lo:13: 00000100:00100000:1.0:1787692279.106871:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692279.106962:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125834496 00000100:00100000:2.0:1787692279.106967:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125834496 00000100:00100000:2.0:1787692279.107005:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787692279.107012:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125834496:12345-0@lo:13: 00002000:00000024:2.0:1787692279.107041:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692279.107082:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125834496:12345-0@lo:13: Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692279.107088:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787692279.107113:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec88aa0e00 x1874531125834496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692279.107128:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125834496:0@lo:13: 00000100:00080000:3.0:1787692279.107249:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787692279.300240:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692280.321007:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692281.345010:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692282.368994:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692283.394004:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787692284.143033:0:7614:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787692284.143038:0:7614:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1787692284.143317:0:7614:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92eb85134000 00000020:01000004:1.0:1787692284.143335:0:7614:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787692284.143348:0:7614:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1787692284.143360:0:7614:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff92eb85144d28) 00000020:00000080:1.0:1787692284.143376:0:7614:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787692284.158446:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787692284.158782:0:7614:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1787692284.177119:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787692284.180754:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787692284.180791:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787692284.180890:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787692284.180917:0:7614:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787692284.181232:0:7614:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787692284.181242:0:7614:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787692284.181255:0:7614:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d8b8560a09de1b2 00000020:01000004:2.0:1787692284.181262:0:7614:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787692284.181279:0:7614:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787692284.181281:0:7614:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787692284.181286:0:7614:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787692284.181302:0:7614:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787692284.181306:0:7614:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787692284.195505:0:7614:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787692284.195545:0:7614:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.127@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787692284.195549:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787692284.195551:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787692284.195552:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692284.195554:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692284.195555:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692284.195556:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692284.195558:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787692284.195559:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787692284.195561:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787692284.195563:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692284.195564:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787692284.195569:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787692284.195571:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787692284.195573:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787692284.195574:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692284.195575:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692284.195577:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692284.195578:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692284.195579:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787692284.195580:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787692284.195581:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787692284.195582:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692284.195583:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787692284.195610:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787692284.195629:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125834624:0@lo:253: 00000100:00100000:2.0:1787692284.195703:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692284.195855:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90400e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787692284.195963:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125834624 00000100:00100000:0.0:1787692284.195971:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125834624 00000100:00100000:0.0:1787692284.196065:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787692284.196075:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+16:7614:x1874531125834624:12345-0@lo:253: 20000000:01000000:0.0:1787692284.196106:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787692284.196110:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787692284.196115:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787692284.196118:0:5826:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787692284.197042:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787692284.197259:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1787692284.197272:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1787692284.197308:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1787692284.197316:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1787692284.197343:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1787692284.197387:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1787692284.197724:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1787692284.197743:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.127@tcp 20000000:01000000:0.0:1787692284.197745:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.127@tcp (null) (null) (null) 00000040:00080000:0.0:1787692284.197777:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1787692284.197784:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787692284.197871:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1787692284.197880:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.127@tcp (null) (null) 00000040:00080000:0.0:1787692284.197913:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1787692284.197922:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787692284.197965:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1787692284.198023:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1787692284.198739:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1787692284.198756:0:5826:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.127@tcp 20000000:01000000:0.0:1787692284.198758:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.127@tcp (null) (null) (null) 00000040:00080000:0.0:1787692284.198791:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1787692284.198799:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787692284.199222:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1787692284.199232:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.127@tcp (null) (null) 00000040:00080000:0.0:1787692284.199267:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1787692284.199276:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1787692284.199324:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1787692284.199362:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1787692284.199380:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1787692284.199383:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1787692284.199389:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787692284.199390:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787692284.199393:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787692284.199404:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787692284.199407:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787692284.199443:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787692284.199445:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787692284.199970:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1787692284.200018:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1787692284.200070:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1787692284.200344:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1787692284.200390:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1787692284.200441:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1787692284.200452:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787692284.200454:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787692284.200784:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1787692284.201088:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1787692284.201124:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1787692284.201193:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1787692284.201207:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1787692284.201209:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787692284.201781:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787692284.201923:0:7618:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787692284.201957:0:7618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1787692284.202207:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1787692284.202245:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1787692284.202322:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1787692284.202335:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787692284.202337:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787692284.202933:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1787692284.202987:0:7619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1787692284.203041:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1787692284.203297:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1787692284.203337:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1787692284.203373:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:0.0:1787692284.203389:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787692284.203408:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.203424:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de10a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de103 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.203431:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de12d expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.203438:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de15e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de157 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.203445:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec813d6400/0x5d8b8560a09de17a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de173 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.203451:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de1a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de19d expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.203458:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.203493:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de19d expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.203507:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de1a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de19d expref: 16 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692284.203528:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125834752:0@lo:104: 00000100:00100000:0.0:1787692284.203598:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787692284.203685:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec813d6400/0x5d8b8560a09de17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de173 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.203693:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ec813d6400/0x5d8b8560a09de17a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de173 expref: 16 pid: 5823 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692284.203702:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125834880:0@lo:104: 00010000:00010000:0.0:1787692284.203724:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de157 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.203732:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de15e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de157 expref: 16 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692284.203739:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125835008:0@lo:104: 00010000:00010000:0.0:1787692284.203759:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de12d expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.203766:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de134 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de12d expref: 16 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692284.203773:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125835136:0@lo:104: 00010000:00010000:0.0:1787692284.203791:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de10a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de103 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.203799:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de10a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de103 expref: 16 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692284.203848:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125835264:0@lo:104: 00000100:00100000:0.0:1787692284.203868:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecaef67840 going to sleep for 11 seconds 00000100:00100000:1.0:1787692284.203963:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787692284.203980:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692284.204049:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692284.204097:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692284.204114:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125834752 00000100:00100000:2.0:1787692284.204125:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125834752 00000100:00100000:2.0:1787692284.204168:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125834880 00000100:00100000:2.0:1787692284.204171:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125834880 00000100:00100000:2.0:1787692284.204180:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125835008 00000100:00100000:2.0:1787692284.204182:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125835008 00000100:00100000:2.0:1787692284.204194:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787692284.204202:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec8b1e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+5:5826:x1874531125834752:12345-0@lo:104: 00010000:00010000:2.0:1787692284.204214:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de1a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.204302:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787692284.204308:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec8b1e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+5:5826:x1874531125834752:12345-0@lo:104: Request processed in 107us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692284.204315:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787692284.204350:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787692284.204356:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+4:5826:x1874531125834880:12345-0@lo:104: 00010000:00010000:2.0:1787692284.204363:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de17a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692284.204437:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125834752:0@lo:104: 00000100:00100000:0.0:1787692284.204445:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125834880:0@lo:104: 00000100:00100000:1.0:1787692284.204489:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692284.204495:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1787692284.204501:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1787692284.204724:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125835136 00000100:00100000:0.0:1787692284.204729:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125835136 00000100:00100000:0.0:1787692284.204749:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1787692284.204753:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125835264 00000100:00100000:0.0:1787692284.204756:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125835264 00000100:00100000:1.0:1787692284.204881:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787692284.204888:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:74f850a3-c102-416a-ae3b-08438aa77de6+6:5826:x1874531125835008:12345-0@lo:104: 00010000:00010000:1.0:1787692284.204897:0:7620:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de15e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.204972:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787692284.204979:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de1a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.204987:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecc62cb600 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:3.0:1787692284.204991:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de1a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205000:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de1a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787692284.205013:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de1a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692284.205020:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787692284.205050:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de1a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205056:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787692284.205072:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de1a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205079:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb600/0x5d8b8560a09de19d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de1a4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205090:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787692284.205094:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de17a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205100:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2200 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:3.0:1787692284.205103:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de17a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205109:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de17a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787692284.205116:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de17a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692284.205121:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787692284.205138:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de17a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205157:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787692284.205163:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de17a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205169:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec814a2200/0x5d8b8560a09de173 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de17a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205178:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692284.205181:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de15e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205187:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecc62cb200 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:3.0:1787692284.205190:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de15e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205196:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de15e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787692284.205202:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de15e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692284.205207:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787692284.205218:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de15e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205223:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787692284.205236:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de15e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205251:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de157 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de15e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205260:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692284.205262:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692284.205264:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692284.205285:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125835392:0@lo:103: 00000100:00100000:3.0:1787692284.205317:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.205349:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692284.205354:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125835520:0@lo:103: 00000100:00100000:3.0:1787692284.205372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.205401:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125835392 00000100:00100000:3.0:1787692284.205405:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125835392 00010000:00010000:3.0:1787692284.205422:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de1a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de19d expref: 17 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692284.205440:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125835520 00000100:00100000:3.0:1787692284.205442:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125835520 00010000:00010000:3.0:1787692284.205451:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec813d6400/0x5d8b8560a09de17a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de173 expref: 18 pid: 5823 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692284.205463:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787692284.205468:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+18:3306:x1874531125835392:12345-0@lo:103: 00010000:00010000:3.0:1787692284.205477:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692284.205482:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de1a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de19d expref: 18 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205493:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de1a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de19d expref: 18 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205512:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de1a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de19d expref: 18 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205523:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692284.205548:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+17:3306:x1874531125835392:12345-0@lo:103: Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692284.205554:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787692284.205567:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787692284.205573:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+16:3306:x1874531125835520:12345-0@lo:103: 00010000:00010000:3.0:1787692284.205579:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692284.205583:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec813d6400/0x5d8b8560a09de17a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de173 expref: 16 pid: 5823 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205592:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec813d6400/0x5d8b8560a09de17a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de173 expref: 16 pid: 5823 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205601:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec813d6400/0x5d8b8560a09de17a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de173 expref: 16 pid: 5823 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.205610:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692284.205627:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+15:3306:x1874531125835520:12345-0@lo:103: Request processed in 54us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692284.205632:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787692284.205661:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125835520:0@lo:103: 00000100:00100000:3.0:1787692284.205668:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125835392:0@lo:103: 00000100:00100000:0.0:1787692284.205727:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787692284.205736:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125835648:0@lo:103: 00000100:00100000:0.0:1787692284.205760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692284.205794:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125835008:0@lo:104: 00000100:00100000:3.0:1787692284.205897:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125835648 00000100:00100000:3.0:1787692284.205901:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125835648 00010000:00010000:3.0:1787692284.205921:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de15e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de157 expref: 15 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692284.205976:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787692284.205983:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+15:3305:x1874531125835648:12345-0@lo:103: 00010000:00010000:3.0:1787692284.206001:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692284.206005:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de15e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de157 expref: 15 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.206015:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de157 expref: 15 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.206024:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a3200/0x5d8b8560a09de15e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de157 expref: 15 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.206034:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692284.206060:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+14:3305:x1874531125835648:12345-0@lo:103: Request processed in 78us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692284.206066:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787692284.206110:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125835648:0@lo:103: 00010000:00010000:2.0:1787692284.206199:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1787692284.206206:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+6:5826:x1874531125834880:12345-0@lo:104: Request processed in 1849us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692284.206212:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787692284.206227:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787692284.206234:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+5:5826:x1874531125835136:12345-0@lo:104: 00010000:00010000:2.0:1787692284.206242:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de134 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206279:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787692284.206289:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+5:5826:x1874531125835136:12345-0@lo:104: Request processed in 56us (2191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692284.206294:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787692284.206308:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787692284.206313:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+4:5826:x1874531125835264:12345-0@lo:104: 00010000:00010000:2.0:1787692284.206321:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de10a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206346:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787692284.206350:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+4:5826:x1874531125835264:12345-0@lo:104: Request processed in 38us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692284.206355:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787692284.206444:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787692284.206449:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de134 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206455:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d7a00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:2.0:1787692284.206459:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de134 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206466:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de134 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787692284.206473:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de134 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692284.206478:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787692284.206501:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de134 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206516:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787692284.206528:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de134 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206535:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de12d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de134 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206544:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692284.206547:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de10a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206553:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecc62caa00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:2.0:1787692284.206556:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de10a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206562:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de10a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787692284.206569:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de10a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692284.206574:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787692284.206585:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de10a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206591:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787692284.206601:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de10a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206607:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ecc62caa00/0x5d8b8560a09de103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de10a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206625:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692284.206627:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692284.206629:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692284.206634:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787692284.206643:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125835776:0@lo:103: 00000100:00100000:2.0:1787692284.206670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692284.206698:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125835776 00000100:00100000:2.0:1787692284.206702:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125835776 00010000:00010000:2.0:1787692284.206715:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de134 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de12d expref: 14 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692284.206733:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787692284.206738:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+14:3304:x1874531125835776:12345-0@lo:103: 00010000:00010000:2.0:1787692284.206745:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692284.206749:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de134 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de12d expref: 14 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206757:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de134 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de12d expref: 14 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206767:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692284.206789:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+14:3304:x1874531125835776:12345-0@lo:103: Request processed in 51us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692284.206795:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787692284.206837:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125835776:0@lo:103: 00000100:00100000:2.0:1787692284.206849:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787692284.206856:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125835904:0@lo:103: 00000100:00100000:2.0:1787692284.206884:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692284.206902:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125835904 00000100:00100000:2.0:1787692284.206905:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125835904 00010000:00010000:2.0:1787692284.206917:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de10a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de103 expref: 14 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692284.206929:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787692284.206934:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+14:3307:x1874531125835904:12345-0@lo:103: 00010000:00010000:2.0:1787692284.206940:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692284.206944:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de10a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de103 expref: 14 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206952:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de10a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de103 expref: 14 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206963:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206970:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206982:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206989:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.206996:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.207002:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.207013:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692284.207017:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.207023:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.207032:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.207040:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692284.207064:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+14:3307:x1874531125835904:12345-0@lo:103: Request processed in 130us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692284.207070:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787692284.207091:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125835904:0@lo:103: 00010000:00010000:2.0:1787692284.207124:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de134 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de12d expref: 13 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692284.207134:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125835136:0@lo:104: 00010000:00010000:2.0:1787692284.207159:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de10a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de103 expref: 12 pid: 5826 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692284.207166:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5826:1874531125835264:0@lo:104: 00010000:00010000:2.0:1787692284.207189:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.207196:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.207211:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.207216:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de1b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787692284.207228:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1787692284.207622:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692284.208256:0:7620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1787692284.208268:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:74f850a3-c102-416a-ae3b-08438aa77de6+3:5826:x1874531125835008:12345-0@lo:104: Request processed in 3378us (4215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692284.208276:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787692284.209574:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692284.225174:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125836160:0@lo:400: 00000100:00100000:2.0:1787692284.225257:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692284.225297:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787692284.225302:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125836288:0@lo:400: 00000100:00100000:2.0:1787692284.225330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692284.225364:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125836160 00000100:00100000:2.0:1787692284.225372:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125836160 00000100:00100000:2.0:1787692284.225426:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787692284.225434:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125836160:12345-0@lo:400: 00000100:00100000:2.0:1787692284.225484:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125836160:12345-0@lo:400: Request processed in 50us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692284.225491:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787692284.225514:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125836032:0@lo:400: 00000100:00100000:2.0:1787692284.225567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692284.225595:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125836032 00000100:00100000:2.0:1787692284.225599:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125836032 00000100:00100000:2.0:1787692284.225620:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787692284.225626:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125836032:12345-0@lo:400: 00000100:00100000:2.0:1787692284.225657:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125836032:12345-0@lo:400: Request processed in 32us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692284.225669:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787692284.225708:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec88aa0000 x1874531125836032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692284.225721:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125836032:0@lo:400: 00010000:00080000:2.0:1787692284.225754:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec88aa2680 x1874531125836160/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692284.225763:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125836160:0@lo:400: 00000100:00100000:0.0:1787692284.225882:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125836288 00000100:00100000:0.0:1787692284.225887:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125836288 00000100:00100000:0.0:1787692284.225929:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787692284.225938:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125836288:12345-0@lo:400: 00000100:00100000:0.0:1787692284.225978:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125836288:12345-0@lo:400: Request processed in 41us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692284.225985:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787692284.226003:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787692284.226010:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125836416:0@lo:13: 00000100:00100000:0.0:1787692284.226036:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692284.226068:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125836416 00000100:00100000:0.0:1787692284.226072:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125836416 00000100:00100000:0.0:1787692284.226096:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787692284.226101:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125836416:12345-0@lo:13: 00002000:00000024:0.0:1787692284.226126:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692284.226172:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125836416:12345-0@lo:13: Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692284.226179:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787692284.226205:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecafba6300 x1874531125836416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692284.226218:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125836416:0@lo:13: 00010000:00080000:0.0:1787692284.226240:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec88aa2d80 x1874531125836288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692284.226248:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125836288:0@lo:400: 00000100:00080000:2.0:1787692284.226587:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787692284.226592:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692284.264598:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+11:7614:x1874531125834624:12345-0@lo:253: Request processed in 68514us (68883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692284.264614:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787692284.264731:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125834624:0@lo:253: 10000000:01000000:3.0:1787692284.264746:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787692284.264750:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787692284.264751:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787692284.264753:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692284.264754:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1787692284.264755:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692284.264756:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692284.264758:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692284.264759:0:7614:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787692284.264761:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692284.264763:0:7614:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787692284.264782:0:7614:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92eb85134000 from lustre-OST0001 10000000:01000000:3.0:1787692284.264860:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787692284.264863:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787692284.264872:0:7614:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92ec87fd3370 local copy 10000000:01000000:3.0:1787692284.264876:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787692284.264916:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.264928:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.264936:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692284.264954:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125836544:0@lo:101: 00000100:00100000:3.0:1787692284.264990:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.265023:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9016cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787692284.265086:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125836544 00000100:00100000:0.0:1787692284.265092:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125836544 00000100:00100000:0.0:1787692284.265156:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787692284.265165:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+11:7614:x1874531125836544:12345-0@lo:101: 00010000:00010000:0.0:1787692284.265177:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692284.265190:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de1c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de1c0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.265211:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de1c0 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.265232:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de1c0 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.265241:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6424200, rc 0) 00000100:00100000:0.0:1787692284.265272:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:7614:x1874531125836544:12345-0@lo:101: Request processed in 109us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692284.265278:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787692284.265572:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125836544:0@lo:101: 00010000:00010000:3.0:1787692284.265585:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5d8b8560a09de1c7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.265594:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d8b8560a09de1c7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692284.265700:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125836672:0@lo:501: 00000100:00100000:3.0:1787692284.265726:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.265747:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9016cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787692284.265798:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125836672 00000100:00100000:0.0:1787692284.265802:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125836672 00000100:00100000:0.0:1787692284.265850:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787692284.265857:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:7614:x1874531125836672:12345-0@lo:501: 00000100:00100000:0.0:1787692284.266027:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:7614:x1874531125836672:12345-0@lo:501: Request processed in 170us (300us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787692284.266034:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787692284.266250:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125836672:0@lo:501: 10000000:01000000:3.0:1787692284.266264:0:7614:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787692284.266287:0:7614:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787692284.266298:0:7614:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5d8b8560a09de1c7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.266306:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d8b8560a09de1c7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.266312:0:7614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5d8b8560a09de1c7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.266335:0:7614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787692284.266357:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92eb85134000 10000000:01000000:3.0:1787692284.266361:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787692284.266366:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787692284.266368:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787692284.266371:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787692284.266374:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787692284.266391:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.266398:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.266406:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692284.266417:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125836800:0@lo:101: 00000100:00100000:3.0:1787692284.266442:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.266464:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125836800 00000100:00100000:3.0:1787692284.266468:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125836800 00000100:00100000:3.0:1787692284.266487:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787692284.266493:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+12:7614:x1874531125836800:12345-0@lo:101: 00010000:00010000:3.0:1787692284.266508:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692284.266518:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de1d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de1ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.266534:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de1ce expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.266541:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de1ce expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.266547:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecc62cb600, rc 0) 00000100:00100000:3.0:1787692284.266570:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125836800:12345-0@lo:101: Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692284.266576:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787692284.266603:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9016c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692284.266615:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125836800:0@lo:101: 00010000:00010000:3.0:1787692284.266625:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de1d5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.266633:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de1d5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692284.266683:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125836928:0@lo:501: 00000100:00100000:3.0:1787692284.266706:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.266725:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125836928 00000100:00100000:3.0:1787692284.266729:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125836928 00000100:00100000:3.0:1787692284.266752:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787692284.266757:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125836928:12345-0@lo:501: 00000100:00100000:3.0:1787692284.266951:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125836928:12345-0@lo:501: Request processed in 192us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692284.266958:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787692284.266985:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9016c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692284.266998:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125836928:0@lo:501: 00000100:00100000:3.0:1787692284.267022:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837056:0@lo:503: 00000100:00100000:3.0:1787692284.267058:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.267077:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125837056 00000100:00100000:3.0:1787692284.267081:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125837056 00000100:00100000:3.0:1787692284.267100:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787692284.267106:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125837056:12345-0@lo:503: 00010000:00010000:0.0:1787692284.267233:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692284.267240:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5d8b8560a09de1c7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.267248:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecc62cba00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692284.267252:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5d8b8560a09de1c7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.267260:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5d8b8560a09de1c7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692284.267266:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5d8b8560a09de1c7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692284.267286:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787692284.267305:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d8b8560a09de1c7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.267312:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787692284.267332:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d8b8560a09de1c7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.267339:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ecc62cba00/0x5d8b8560a09de1c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5d8b8560a09de1c7 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.267353:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692284.267354:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692284.267356:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692284.267368:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125837184:0@lo:103: 00000100:00100000:0.0:1787692284.267400:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692284.267435:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125837184 00000100:00100000:0.0:1787692284.267439:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125837184 00000100:00100000:0.0:1787692284.267468:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787692284.267475:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+14:3307:x1874531125837184:12345-0@lo:103: 00010000:00010000:0.0:1787692284.267484:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692284.267498:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de1c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de1c0 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.267508:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692284.267533:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+13:3307:x1874531125837184:12345-0@lo:103: Request processed in 59us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692284.267540:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787692284.267575:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125837184:0@lo:103: 00000100:00100000:3.0:1787692284.269365:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:7614:x1874531125837056:12345-0@lo:503: Request processed in 2252us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692284.269376:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787692284.269436:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9016c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692284.269458:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837056:0@lo:503: 00000040:00080000:3.0:1787692284.269752:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787692284.269866:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837312:0@lo:502: 00000100:00100000:3.0:1787692284.269913:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.269939:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9016c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692284.269948:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125837312 00000100:00100000:1.0:1787692284.269954:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125837312 00000100:00100000:1.0:1787692284.269990:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787692284.269999:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:7614:x1874531125837312:12345-0@lo:502: 00000100:00100000:1.0:1787692284.270152:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:7614:x1874531125837312:12345-0@lo:502: Request processed in 144us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692284.270160:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787692284.270509:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837312:0@lo:502: 00000040:00080000:3.0:1787692284.270721:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787692284.270765:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787692284.270792:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787692284.271008:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787692284.271052:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787692284.271096:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787692284.271358:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837440:0@lo:502: 00000100:00100000:3.0:1787692284.271404:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.271474:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9016c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692284.272159:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125837440 00000100:00100000:2.0:1787692284.272171:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125837440 00000100:00100000:2.0:1787692284.272217:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787692284.272226:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+12:7614:x1874531125837440:12345-0@lo:502: 00000100:00100000:2.0:1787692284.272464:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+12:7614:x1874531125837440:12345-0@lo:502: Request processed in 239us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692284.272472:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787692284.272715:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837440:0@lo:502: 00000040:00080000:3.0:1787692284.272893:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787692284.272907:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787692284.273626:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787692284.273634:0:7621:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787692284.273642:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692284.273644:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787692284.273648:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787692284.273662:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff92ecaee599b8) 00000020:00000080:3.0:1787692284.273681:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787692284.273685:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787692284.273749:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92eb85134000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787692284.273755:0:7621:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787692284.273761:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d8b8560a09de1e3 00010000:00010000:0.0:1787692284.280617:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787692284.282356:0:7621:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787692284.290493:0:7621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787692284.290776:0:7621:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787692284.295606:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787692284.296990:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787692284.298390:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787692284.298406:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787692284.298413:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692284.298415:0:7621:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787692284.298418:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787692284.298422:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692284.298424:0:7621:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787692284.298426:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787692284.298428:0:7621:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787692284.298482:0:7621:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787692284.298485:0:7621:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692284.298487:0:7621:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787692284.298490:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787692284.301475:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787692284.301513:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787692284.301539:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de1d5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.301549:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de1d5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692284.301557:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92eb85134000 from 1 10000000:01000000:3.0:1787692284.301559:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787692284.301595:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.301612:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.301622:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692284.301645:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837568:0@lo:101: 00000100:00100000:3.0:1787692284.301908:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.301952:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca89576c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692284.301978:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125837568 00000100:00100000:3.0:1787692284.301985:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125837568 00000100:00100000:3.0:1787692284.302028:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787692284.302037:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+12:7614:x1874531125837568:12345-0@lo:101: 00010000:00010000:3.0:1787692284.302049:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692284.302061:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecc62ca200/0x5d8b8560a09de1f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de1ea expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.302084:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecc62ca200/0x5d8b8560a09de1f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de1ea expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.302094:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecc62ca200/0x5d8b8560a09de1f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de1ea expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.302103:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecc62ca200, rc 0) 00000100:00100000:3.0:1787692284.302163:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125837568:12345-0@lo:101: Request processed in 127us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692284.302170:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787692284.302189:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ff800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837568:0@lo:101: 00010000:00010000:0.0:1787692284.302204:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de1f1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.302215:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de1f1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692284.302331:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837696:0@lo:501: 00000100:00100000:0.0:1787692284.302363:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692284.302438:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecbc3c0780 going to sleep for 11 seconds 00000100:00100000:1.0:1787692284.302480:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125837696 00000100:00100000:1.0:1787692284.302489:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125837696 00000100:00100000:1.0:1787692284.302585:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787692284.302593:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125837696:12345-0@lo:501: 00000100:00100000:1.0:1787692284.302852:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125837696:12345-0@lo:501: Request processed in 260us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692284.302858:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787692284.302942:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837696:0@lo:501: 00000100:00100000:3.0:1787692284.302985:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837824:0@lo:503: 00000100:00100000:3.0:1787692284.303027:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.303053:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90137a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787692284.303065:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125837824 00000100:00100000:0.0:1787692284.303071:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125837824 00000100:00100000:0.0:1787692284.303103:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787692284.303110:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125837824:12345-0@lo:503: 00000100:00100000:0.0:1787692284.303442:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125837824:12345-0@lo:503: Request processed in 332us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692284.303451:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787692284.304753:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837824:0@lo:503: 00000040:00080000:1.0:1787692284.305089:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787692284.305183:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837952:0@lo:502: 00000100:00100000:1.0:1787692284.305241:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692284.305330:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb49540c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692284.305476:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125837952 00000100:00100000:2.0:1787692284.305483:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125837952 00000100:00100000:2.0:1787692284.305552:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787692284.305563:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125837952:12345-0@lo:502: 00000100:00100000:2.0:1787692284.305829:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125837952:12345-0@lo:502: Request processed in 250us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692284.305837:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787692284.305914:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125837952:0@lo:502: 00000040:00080000:1.0:1787692284.306167:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787692284.306213:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787692284.306241:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125838080:0@lo:502: 00000100:00100000:1.0:1787692284.306275:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692284.306343:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb49540c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692284.306380:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125838080 00000100:00100000:3.0:1787692284.306385:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125838080 00000100:00100000:3.0:1787692284.306414:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787692284.306420:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125838080:12345-0@lo:502: 00000100:00100000:3.0:1787692284.306594:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125838080:12345-0@lo:502: Request processed in 173us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692284.306601:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787692284.306767:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125838080:0@lo:502: 00000040:00080000:1.0:1787692284.306981:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787692284.306991:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787692284.307465:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787692284.307476:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692284.307479:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787692284.307485:0:7625:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92eb85134000 00000020:00000080:3.0:1787692284.307487:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787692284.307506:0:7625:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787692284.307510:0:7625:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692284.307511:0:7625:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787692284.307513:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787692284.307648:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787692284.307667:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787692284.307717:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de1f1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692284.307728:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de1f1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692284.307777:0:7614:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787692284.307780:0:7614:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92eb85134000 10000000:01000000:1.0:1787692284.307783:0:7614:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92eb85134000 10000000:01000000:1.0:1787692284.307787:0:7614:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787692284.307792:0:7614:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92eb85134000 from 1 10000000:01000000:1.0:1787692284.307795:0:7614:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787692284.307856:0:7614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692284.307865:0:7614:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692284.307876:0:7614:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692284.307892:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125838208:0@lo:101: 00000100:00100000:1.0:1787692284.307939:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692284.307968:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4954000 going to sleep for 11 seconds 00000100:00100000:2.0:1787692284.308327:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125838208 00000100:00100000:2.0:1787692284.308333:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125838208 00000100:00100000:2.0:1787692284.308375:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787692284.308390:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125838208:12345-0@lo:101: 00010000:00010000:2.0:1787692284.308402:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692284.308414:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de1ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de1f8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.308435:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de1ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de1f8 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.308446:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de1ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de1f8 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692284.308455:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3800, rc 0) 00000100:00100000:2.0:1787692284.308489:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+14:7614:x1874531125838208:12345-0@lo:101: Request processed in 102us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692284.308495:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787692284.308616:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125838208:0@lo:101: 00010000:00010000:1.0:1787692284.308631:0:7614:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de1ff expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692284.308641:0:7614:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de1ff expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692284.308734:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125838336:0@lo:501: 00000100:00100000:1.0:1787692284.308761:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692284.308851:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4954000 going to sleep for 11 seconds 00000100:00100000:3.0:1787692284.309061:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125838336 00000100:00100000:3.0:1787692284.309066:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125838336 00000100:00100000:3.0:1787692284.309127:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787692284.309136:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:7614:x1874531125838336:12345-0@lo:501: 00000100:00100000:3.0:1787692284.309369:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:7614:x1874531125838336:12345-0@lo:501: Request processed in 234us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692284.309378:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787692284.309491:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125838336:0@lo:501: 00000100:00100000:1.0:1787692284.309521:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125838464:0@lo:503: 00000100:00100000:1.0:1787692284.309555:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692284.309656:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4954000 going to sleep for 11 seconds 00000100:00100000:2.0:1787692284.309715:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125838464 00000100:00100000:2.0:1787692284.309721:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125838464 00000100:00100000:2.0:1787692284.309741:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787692284.309747:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+14:7614:x1874531125838464:12345-0@lo:503: 00000100:00100000:2.0:1787692284.309965:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+14:7614:x1874531125838464:12345-0@lo:503: Request processed in 216us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692284.309971:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787692284.310106:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125838464:0@lo:503: 00000040:00080000:1.0:1787692284.310386:0:7614:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787692284.310448:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125838592:0@lo:502: 00000100:00100000:1.0:1787692284.310481:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692284.310543:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4954000 going to sleep for 11 seconds 00000100:00100000:2.0:1787692284.310589:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125838592 00000100:00100000:2.0:1787692284.310593:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125838592 00000100:00100000:2.0:1787692284.310654:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787692284.310661:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+14:7614:x1874531125838592:12345-0@lo:502: 00000100:00100000:2.0:1787692284.310852:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+14:7614:x1874531125838592:12345-0@lo:502: Request processed in 191us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692284.310867:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787692284.310944:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125838592:0@lo:502: 00000040:00080000:1.0:1787692284.311198:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787692284.311259:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787692284.311295:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787692284.311351:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787692284.311390:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787692284.311455:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787692284.311490:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787692284.311523:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787692284.311570:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787692284.311605:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787692284.311639:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787692284.311685:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787692284.311722:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787692284.311755:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787692284.311801:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787692284.311886:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787692284.311930:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787692284.311997:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787692284.312043:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787692284.312077:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787692284.312126:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787692284.312176:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787692284.312209:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787692284.312255:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787692284.312291:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787692284.312324:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787692284.312370:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787692284.312408:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1787692284.312439:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787692284.312482:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1787692284.312514:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1787692284.312546:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1787692284.312625:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1787692284.312693:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1787692284.312730:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1787692284.312775:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1787692284.313438:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1787692284.313490:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125838720:0@lo:502: 00000100:00100000:1.0:1787692284.313569:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692284.313670:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4954000 going to sleep for 11 seconds 00000100:00100000:0.0:1787692284.313722:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125838720 00000100:00100000:0.0:1787692284.313729:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125838720 00000100:00100000:0.0:1787692284.313846:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787692284.313856:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+14:7614:x1874531125838720:12345-0@lo:502: 00000100:00100000:0.0:1787692284.314065:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+14:7614:x1874531125838720:12345-0@lo:502: Request processed in 210us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692284.314072:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787692284.314170:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125838720:0@lo:502: 00000040:00080000:1.0:1787692284.314243:0:7614:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1787692284.314254:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1787692284.317302:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1787692284.317333:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff92ecb4d4b370) 00000020:00000080:2.0:1787692284.317363:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1787692284.317442:0:7626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92eb85134000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787692284.317446:0:7626:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92eb85134000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787692284.317449:0:7626:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92eb85134000 3 00010000:00080000:2.0:1787692284.317479:0:7626:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92ecb4d51800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.127@tcp at head 00010000:00010000:3.0:1787692284.321117:0:7626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1787692284.321389:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787692284.321436:0:7626:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787692284.321459:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5d8b8560a09de20d 00000100:00080000:3.0:1787692284.321469:0:7626:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787692284.321475:0:7626:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92ecb4d51800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:3.0:1787692284.321506:0:7626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecae9fdf80 x1874531125838848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787692284.321531:0:7626:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787692284.321663:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874531125838848:0@lo:38: 00000100:00100000:0.0:1787692284.321742:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.322238:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125838848 00000100:00100000:3.0:1787692284.322246:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125838848 00000100:00100000:3.0:1787692284.323274:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787692284.323283:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1874531125838848:12345-0@lo:38: 00010000:00080000:3.0:1787692284.323310:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1787692284.323344:0:5832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5d8b8560a09de214 00000004:00100000:3.0:1787692284.323359:0:5832:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787692284.325242:0:5832:0:(import.c:65:import_set_state_nolock()) ffff92eb86da5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787692284.325391:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874531125838848:12345-0@lo:38: Request processed in 2104us (3645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692284.325400:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787692284.325463:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecae9fdf80 x1874531125838848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787692294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692284.325474:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787692284.325481:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787692284.325489:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787692284.325493:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787692284.325495:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d51800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787692284.325501:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874531125838848:0@lo:38: 00000040:00080000:2.0:1787692284.325660:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1787692284.325737:0:7614:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787692284.325781:0:7614:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787692284.325800:0:7614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de1ff expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.325841:0:7614:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de1ff expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787692284.325889:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000100:00100000:2.0:1787692284.325892:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7628:1874531125838976:0@lo:901: 00000020:01000004:3.0:1787692284.325893:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787692284.325900:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692284.325902:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692284.325903:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692284.325905:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692284.325906:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692284.325908:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787692284.325909:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787692284.325911:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692284.325913:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787692284.325917:0:7614:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787692284.325920:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787692284.325921:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787692284.325923:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692284.325924:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692284.325926:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692284.325927:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692284.325928:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692284.325930:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787692284.325931:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787692284.325933:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692284.325934:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1787692284.325944:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1787692284.325950:0:7614:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787692284.325961:0:7614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125839104:0@lo:253: 00000100:00100000:2.0:1787692284.325980:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec84cdccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692284.325984:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125838976 00000100:00100000:1.0:1787692284.325992:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125838976 00000100:00100000:3.0:1787692284.326004:0:7614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.326037:0:7614:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec908d6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787692284.326051:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787692284.326056:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125839104 00000100:00100000:3.0:1787692284.326061:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125839104 00000100:00100000:1.0:1787692284.326063:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7628:x1874531125838976:12345-0@lo:901: 00000100:00100000:3.0:1787692284.326099:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787692284.326108:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:7614:x1874531125839104:12345-0@lo:253: 20000000:01000000:3.0:1787692284.326139:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787692284.326169:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1787692284.326249:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692284.326805:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7628:x1874531125838976:12345-0@lo:901: Request processed in 742us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692284.326862:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787692284.327379:0:7628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec88aa2680 x1874531125838976/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787692300 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692284.327393:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7628:1874531125838976:0@lo:901: 20000000:01000000:1.0:1787692284.343718:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787692284.343738:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787692284.343831:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787692284.343835:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787692284.343857:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.343888:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de16c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de165 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.343897:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.343936:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de16c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de165 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.343949:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de16c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de165 expref: 14 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692284.343963:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874531125839232:0@lo:104: 00000100:00100000:0.0:1787692284.344219:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692284.344265:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec832ff540 going to sleep for 11 seconds 00000100:00100000:1.0:1787692284.344327:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125839232 00000100:00100000:1.0:1787692284.344335:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125839232 00000100:00100000:1.0:1787692284.344383:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787692284.344393:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+3:5847:x1874531125839232:12345-0@lo:104: 00010000:00010000:1.0:1787692284.344405:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de16c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692284.344465:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787692284.344471:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+3:5847:x1874531125839232:12345-0@lo:104: Request processed in 81us (253us total) trans 0 rc 0/0 00010000:00010000:3.0:1787692284.344474:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787692284.344479:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787692284.344486:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de16c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344493:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d7600 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:3.0:1787692284.344497:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de16c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344504:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de16c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787692284.344510:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de16c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692284.344513:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787692284.344544:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de16c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344548:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787692284.344565:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba5f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1874531125839232:0@lo:104: 00010000:00010000:3.0:1787692284.344566:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de16c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344575:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de165 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de16c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344589:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692284.344589:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344591:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692284.344594:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692284.344615:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125839360:0@lo:103: 00000100:00100000:0.0:1787692284.344660:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692284.344682:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125839360 00000100:00100000:3.0:1787692284.344685:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125839360 00010000:00010000:3.0:1787692284.344702:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de16c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de165 expref: 15 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692284.344732:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787692284.344737:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+15:3304:x1874531125839360:12345-0@lo:103: 00010000:00010000:3.0:1787692284.344745:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692284.344748:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de16c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de165 expref: 15 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344755:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de16c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de165 expref: 15 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344777:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de16c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de165 expref: 15 pid: 5825 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344790:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344797:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787692284.344839:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004802226s 00010000:00010000:3.0:1787692284.344844:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344851:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344858:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344864:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344875:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692284.344878:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344883:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344892:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692284.344899:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692284.344930:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+14:3304:x1874531125839360:12345-0@lo:103: Request processed in 192us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692284.344936:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787692284.345023:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125839360:0@lo:103: 00010000:00010000:0.0:1787692284.345047:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.345121:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692284.345139:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6424200/0x5d8b8560a09de21b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692284.351311:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:7614:x1874531125839104:12345-0@lo:253: Request processed in 25195us (25298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692284.351326:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787692284.351455:0:7614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:74f850a3-c102-416a-ae3b-08438aa77de6:7614:1874531125839104:0@lo:253: 10000000:01000000:3.0:1787692284.351482:0:7614:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787692284.351486:0:7614:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787692284.351488:0:7614:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787692284.351489:0:7614:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692284.351490:0:7614:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692284.351492:0:7614:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692284.351493:0:7614:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692284.351495:0:7614:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692284.351496:0:7614:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787692284.351498:0:7614:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787692284.351499:0:7614:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692284.351501:0:7614:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787692284.351515:0:7614:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787692284.355930:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692284.356110:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787692284.356338:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692284.356503:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787692284.356725:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692284.356956:0:7614:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787692284.358028:0:7614:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1787692284.417196:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787692284.515615:0:7614:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787692284.515625:0:7614:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787692284.515657:0:7614:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787692284.515710:0:7614:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.127@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787692284.515724:0:7614:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787692284.515747:0:7614:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787692285.441799:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692286.464960:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692287.490840:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692288.516367:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692289.346102:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125839488:0@lo:13: 00000100:00100000:0.0:1787692289.346181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692289.346274:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125839488 00000100:00100000:0.0:1787692289.346281:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125839488 00000100:00100000:0.0:1787692289.346344:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787692289.346361:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125839488:12345-0@lo:13: 00002000:00000024:0.0:1787692289.346396:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692289.346440:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125839488:12345-0@lo:13: Request processed in 88us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692289.346447:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787692289.346493:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecafba5f80 x1874531125839488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692289.346512:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125839488:0@lo:13: 00000100:00100000:0.0:1787692289.350165:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125839616:0@lo:400: 00000100:00100000:0.0:1787692289.350410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692289.350462:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692289.350470:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125839744:0@lo:400: 00000100:00100000:0.0:1787692289.350506:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692289.350543:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125839616 00000100:00100000:0.0:1787692289.350550:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125839616 00000100:00100000:0.0:1787692289.350609:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787692289.350620:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:3306:x1874531125839616:12345-0@lo:400: 00000100:00100000:0.0:1787692289.350670:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:3306:x1874531125839616:12345-0@lo:400: Request processed in 52us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692289.350677:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787692289.350708:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125839744 00000100:00100000:0.0:1787692289.350712:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125839744 00000100:00100000:0.0:1787692289.350840:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787692289.350852:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125839744:12345-0@lo:400: 00000100:00100000:0.0:1787692289.350884:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125839744:12345-0@lo:400: Request processed in 37us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692289.350890:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787692289.350913:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125839872:0@lo:400: 00000100:00100000:0.0:1787692289.350938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692289.350960:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787692289.350967:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125840000:0@lo:400: 00000100:00100000:0.0:1787692289.350989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692289.351012:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125839872 00000100:00100000:0.0:1787692289.351016:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125839872 00000100:00100000:0.0:1787692289.351040:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125840000 00000100:00100000:0.0:1787692289.351043:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125840000 00000100:00100000:0.0:1787692289.351061:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787692289.351068:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125839872:12345-0@lo:400: 00000100:00100000:0.0:1787692289.351101:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125839872:12345-0@lo:400: Request processed in 34us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692289.351466:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787692289.351484:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787692289.351492:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125840000:12345-0@lo:400: 00000100:00100000:0.0:1787692289.351524:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125840000:12345-0@lo:400: Request processed in 35us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692289.351529:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787692289.351570:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecafba3b80 x1874531125840000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692289.351585:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125840000:0@lo:400: 00010000:00080000:0.0:1787692289.351596:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecafba1180 x1874531125839872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692289.351604:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125839872:0@lo:400: 00010000:00080000:0.0:1787692289.351638:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecafba0000 x1874531125839744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692289.351648:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125839744:0@lo:400: 00000100:00100000:0.0:1787692289.351658:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125839616:0@lo:400: 00000100:00080000:0.0:1787692289.354973:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787692289.354983:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787692289.542343:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787692290.554457:0:7969:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787692290.563379:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692291.585756:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692292.615075:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787692292.929664:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787692292.929671:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ecafbbe800 from 30 10000000:01000000:1.0:1787692292.929676:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787692292.929716:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.929727:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.929751:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692292.929775:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125840128:0@lo:101: 00000100:00100000:1.0:1787692292.929875:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692292.929963:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07540 going to sleep for 11 seconds 00000100:00100000:3.0:1787692292.934749:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125840128 00000100:00100000:3.0:1787692292.934763:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125840128 00000100:00100000:3.0:1787692292.935142:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787692292.935163:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:5828:x1874531125840128:12345-0@lo:101: 00010000:00010000:3.0:1787692292.935179:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692292.935198:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecc62ca000/0x5d8b8560a09de229 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de222 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.935223:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecc62ca000/0x5d8b8560a09de229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de222 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.935232:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecc62ca000/0x5d8b8560a09de229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de222 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.935240:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecc62ca000, rc 0) 00000100:00100000:3.0:1787692292.935327:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125840128:12345-0@lo:101: Request processed in 175us (5452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692292.935333:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1787692292.935415:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125840128:0@lo:101: 00010000:00010000:0.0:1787692292.935434:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de229 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692292.935444:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de229 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692292.935530:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125840256:0@lo:501: 00000100:00100000:0.0:1787692292.935739:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692292.948025:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4b8bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787692292.954543:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125840256 00000100:00100000:1.0:1787692292.954558:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125840256 00000100:00100000:1.0:1787692292.954629:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787692292.954640:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125840256:12345-0@lo:501: 00000100:00100000:1.0:1787692292.955048:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125840256:12345-0@lo:501: Request processed in 408us (19308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692292.955055:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787692292.956601:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125840256:0@lo:501: 00000100:00100000:0.0:1787692292.956656:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125840384:0@lo:503: 00000100:00100000:0.0:1787692292.956724:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692292.956755:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4b8bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1787692292.958197:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125840384 00000100:00100000:3.0:1787692292.958209:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125840384 00000100:00100000:3.0:1787692292.958265:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787692292.958274:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125840384:12345-0@lo:503: 00000100:00100000:3.0:1787692292.958670:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125840384:12345-0@lo:503: Request processed in 395us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692292.958677:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787692292.958944:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125840384:0@lo:503: 00000100:00100000:0.0:1787692292.960250:0:8074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8074:1874531125840512:0@lo:502: 00000100:00100000:0.0:1787692292.960317:0:8074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692292.960407:0:8074:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4b8b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692292.961808:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125840512 00000100:00100000:3.0:1787692292.961843:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125840512 00000100:00100000:0.0:1787692292.962136:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787692292.962146:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:8074:x1874531125840512:12345-0@lo:502: 00000100:00100000:0.0:1787692292.962785:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:8074:x1874531125840512:12345-0@lo:502: Request processed in 638us (2465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692292.962794:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787692292.964508:0:8074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8074:1874531125840512:0@lo:502: 00000100:00100000:3.0:1787692292.964598:0:8074:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8074:1874531125840640:0@lo:502: 00000100:00100000:3.0:1787692292.964665:0:8074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692292.964709:0:8074:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787692292.965328:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125840640 00000100:00100000:0.0:1787692292.965336:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125840640 00000100:00100000:0.0:1787692292.965389:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787692292.965398:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+14:8074:x1874531125840640:12345-0@lo:502: 00000100:00100000:0.0:1787692292.966463:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+14:8074:x1874531125840640:12345-0@lo:502: Request processed in 1062us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692292.966473:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787692292.966589:0:8074:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8074:1874531125840640:0@lo:502: 00000040:00080000:3.0:1787692292.966621:0:8074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787692292.969620:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787692292.969656:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787692292.969667:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de229 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.969679:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de229 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692292.969690:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1787692292.969693:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1787692292.969695:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787692292.969731:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.969740:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.969764:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692292.969786:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125840768:0@lo:101: 00000100:00100000:1.0:1787692292.970060:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692292.970116:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07180 going to sleep for 11 seconds 00000100:00100000:3.0:1787692292.970294:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125840768 00000100:00100000:3.0:1787692292.970302:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125840768 00000100:00100000:3.0:1787692292.970352:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787692292.970361:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125840768:12345-0@lo:101: 00010000:00010000:3.0:1787692292.970373:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692292.970385:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecc62cb800/0x5d8b8560a09de237 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de230 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.970669:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecc62cb800/0x5d8b8560a09de237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de230 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.970682:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecc62cb800/0x5d8b8560a09de237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de230 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.970692:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecc62cb800, rc 0) 00000100:00100000:3.0:1787692292.970797:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125840768:12345-0@lo:101: Request processed in 437us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692292.970803:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787692292.970952:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125840768:0@lo:101: 00010000:00010000:1.0:1787692292.970967:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de237 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.970975:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de237 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692292.971213:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125840896:0@lo:501: 00000100:00100000:1.0:1787692292.971319:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692292.971351:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07180 going to sleep for 11 seconds 00000100:00100000:3.0:1787692292.971402:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125840896 00000100:00100000:3.0:1787692292.971408:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125840896 00000100:00100000:3.0:1787692292.971484:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787692292.971492:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125840896:12345-0@lo:501: 00000100:00100000:1.0:1787692292.972103:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125840896:0@lo:501: 00000100:00100000:1.0:1787692292.972136:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125841024:0@lo:503: 00000100:00100000:1.0:1787692292.972178:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692292.972205:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07180 going to sleep for 11 seconds 00000100:00100000:3.0:1787692292.972293:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125840896:12345-0@lo:501: Request processed in 494us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692292.972305:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787692292.972307:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125841024 00000100:00100000:2.0:1787692292.972314:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125841024 00000100:00100000:2.0:1787692292.972361:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787692292.972370:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125841024:12345-0@lo:503: 00000100:00100000:2.0:1787692292.972677:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125841024:12345-0@lo:503: Request processed in 306us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692292.972684:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1787692292.972727:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125841024:0@lo:503: 00000100:00100000:2.0:1787692292.974761:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8075:1874531125841152:0@lo:502: 00000100:00100000:2.0:1787692292.974859:0:8075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692292.974893:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec903eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787692292.975305:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125841152 00000100:00100000:3.0:1787692292.975312:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125841152 00000100:00100000:3.0:1787692292.975354:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787692292.975362:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+15:8075:x1874531125841152:12345-0@lo:502: 00000100:00100000:3.0:1787692292.976154:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+15:8075:x1874531125841152:12345-0@lo:502: Request processed in 787us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692292.976163:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787692292.981427:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8075:1874531125841152:0@lo:502: 00000020:01000000:2.0:1787692292.981482:0:8075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787692292.981497:0:8075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787692292.981499:0:8075:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787692292.981517:0:8075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787692292.981519:0:8075:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787692292.981554:0:8075:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8075:1874531125841280:0@lo:502: 00000100:00100000:2.0:1787692292.981631:0:8075:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692292.981675:0:8075:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec903eac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787692292.981764:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125841280 00000100:00100000:0.0:1787692292.981772:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125841280 00000100:00100000:0.0:1787692292.981847:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787692292.981857:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+15:8075:x1874531125841280:12345-0@lo:502: 00000100:00100000:0.0:1787692292.982106:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+15:8075:x1874531125841280:12345-0@lo:502: Request processed in 240us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692292.982114:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787692292.982183:0:8075:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8075:1874531125841280:0@lo:502: 00000020:01000000:3.0:1787692292.982222:0:8075:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787692292.982227:0:8075:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692292.982228:0:8075:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787692292.982232:0:8075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1787692292.982673:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787692292.982693:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787692292.982703:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de237 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.982725:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de237 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692292.982736:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787692292.982739:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ec9dbcc000 from 30 10000000:01000000:1.0:1787692292.982742:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787692292.982766:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.982774:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.982782:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692292.982798:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125841408:0@lo:101: 00000100:00100000:1.0:1787692292.983013:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692292.983075:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07180 going to sleep for 11 seconds 00000100:00100000:3.0:1787692292.983123:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125841408 00000100:00100000:3.0:1787692292.983129:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125841408 00000100:00100000:3.0:1787692292.983202:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787692292.983210:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125841408:12345-0@lo:101: 00010000:00010000:3.0:1787692292.983229:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692292.983247:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de245 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de23e expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.983269:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de23e expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.983281:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de23e expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.983289:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecc62cba00, rc 0) 00000100:00100000:3.0:1787692292.983374:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125841408:12345-0@lo:101: Request processed in 165us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692292.983381:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787692292.983612:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125841408:0@lo:101: 00010000:00010000:1.0:1787692292.983626:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de245 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.983636:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de245 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692292.983680:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125841536:0@lo:501: 00000100:00100000:1.0:1787692292.983705:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692292.983737:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07180 going to sleep for 11 seconds 00000100:00100000:2.0:1787692292.983802:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125841536 00000100:00100000:2.0:1787692292.983806:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125841536 00000100:00100000:2.0:1787692292.983856:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787692292.983863:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125841536:12345-0@lo:501: 00000100:00100000:2.0:1787692292.984112:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125841536:12345-0@lo:501: Request processed in 231us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692292.984121:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787692292.984207:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125841536:0@lo:501: 00000100:00100000:1.0:1787692292.984302:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125841664:0@lo:503: 00000100:00100000:1.0:1787692292.984336:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692292.984363:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07180 going to sleep for 11 seconds 00000100:00100000:0.0:1787692292.984427:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125841664 00000100:00100000:0.0:1787692292.984432:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125841664 00000100:00100000:0.0:1787692292.984452:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787692292.984458:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125841664:12345-0@lo:503: 00000100:00100000:0.0:1787692292.984759:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125841664:12345-0@lo:503: Request processed in 299us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692292.984767:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787692292.985052:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125841664:0@lo:503: 00000100:00100000:1.0:1787692292.985691:0:8076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8076:1874531125841792:0@lo:502: 00000100:00100000:1.0:1787692292.985742:0:8076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692292.985773:0:8076:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07540 going to sleep for 11 seconds 00000100:00100000:0.0:1787692292.985830:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125841792 00000100:00100000:0.0:1787692292.985835:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125841792 00000100:00100000:0.0:1787692292.985910:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787692292.985919:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:8076:x1874531125841792:12345-0@lo:502: 00000100:00100000:0.0:1787692292.986132:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:8076:x1874531125841792:12345-0@lo:502: Request processed in 214us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692292.986140:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787692292.986377:0:8076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8076:1874531125841792:0@lo:502: 00000100:00100000:1.0:1787692292.986438:0:8076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8076:1874531125841920:0@lo:502: 00000100:00100000:1.0:1787692292.986473:0:8076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692292.986595:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125841920 00000100:00100000:0.0:1787692292.986600:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125841920 00000100:00100000:0.0:1787692292.986631:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787692292.986638:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:8076:x1874531125841920:12345-0@lo:502: 00000100:00100000:0.0:1787692292.986770:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:8076:x1874531125841920:12345-0@lo:502: Request processed in 133us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692292.986787:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787692292.987117:0:8076:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07540 going to sleep for 11 seconds 00000100:00100000:1.0:1787692292.987134:0:8076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8076:1874531125841920:0@lo:502: 00000040:00080000:1.0:1787692292.987155:0:8076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787692292.987293:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787692292.987312:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787692292.987321:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de245 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692292.987331:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de245 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692292.987341:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787692292.987344:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92ec9dbcc000 from 5 10000000:01000000:0.0:1787692292.987346:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787692292.987372:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692292.987380:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692292.987389:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692292.987414:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125842048:0@lo:101: 00000100:00100000:0.0:1787692292.987446:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692292.987478:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a46900 going to sleep for 11 seconds 00000100:00100000:3.0:1787692292.987524:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125842048 00000100:00100000:3.0:1787692292.987530:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125842048 00000100:00100000:3.0:1787692292.987565:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787692292.987573:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125842048:12345-0@lo:101: 00010000:00010000:3.0:1787692292.987583:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692292.987594:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de253 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de24c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.987613:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de24c expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.987622:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de24c expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.987630:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecc62cac00, rc 0) 00000100:00100000:3.0:1787692292.987662:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125842048:12345-0@lo:101: Request processed in 90us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692292.987678:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787692292.987862:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125842048:0@lo:101: 00010000:00010000:0.0:1787692292.987875:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692292.987884:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692292.987932:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125842176:0@lo:256: 00000100:00100000:0.0:1787692292.987960:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692292.987971:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a46900 going to sleep for 11 seconds 00000100:00100000:3.0:1787692292.988425:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125842176 00000100:00100000:3.0:1787692292.988431:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125842176 00000100:00100000:3.0:1787692292.988463:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787692292.988470:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125842176:12345-0@lo:256: 20000000:01000000:3.0:1787692292.988483:0:5823:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787692292.988509:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787692292.988512:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1787692292.988599:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125842176:12345-0@lo:256: Request processed in 129us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692292.988606:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787692292.988931:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125842176:0@lo:256: 10000000:01000000:1.0:1787692292.988979:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787692292.988985:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.988993:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692292.989001:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787692292.989004:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787692292.989011:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787692292.989034:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.989040:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.989048:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692292.989061:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125842304:0@lo:101: 00000100:00100000:1.0:1787692292.989092:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692292.989127:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07540 going to sleep for 11 seconds 00000100:00100000:3.0:1787692292.989191:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125842304 00000100:00100000:3.0:1787692292.989195:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125842304 00000100:00100000:3.0:1787692292.989593:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787692292.989602:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125842304:12345-0@lo:101: 00010000:00010000:3.0:1787692292.989611:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692292.989621:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecc62caa00/0x5d8b8560a09de261 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de25a expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.989640:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecc62caa00/0x5d8b8560a09de261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de25a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.989649:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecc62caa00/0x5d8b8560a09de261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de25a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692292.989656:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecc62caa00, rc 0) 00000100:00100000:3.0:1787692292.989700:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125842304:12345-0@lo:101: Request processed in 100us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692292.989716:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787692292.989775:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125842304:0@lo:101: 00010000:00010000:1.0:1787692292.989787:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de261 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692292.989796:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de261 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692292.989865:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125842432:0@lo:501: 00000100:00100000:1.0:1787692292.989891:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692292.989968:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125842432 00000100:00100000:2.0:1787692292.989973:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125842432 00000100:00100000:2.0:1787692292.989996:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787692292.990003:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125842432:12345-0@lo:501: 00000100:00100000:2.0:1787692292.990264:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125842432:12345-0@lo:501: Request processed in 260us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692292.990270:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787692292.990615:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07540 going to sleep for 11 seconds 00000100:00100000:0.0:1787692292.990706:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125842432:0@lo:501: 00000100:00100000:0.0:1787692292.990741:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125842560:0@lo:503: 00000100:00100000:0.0:1787692292.990781:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692292.990917:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a466c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692292.991018:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125842560 00000100:00100000:2.0:1787692292.991023:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125842560 00000100:00100000:1.0:1787692292.991170:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787692292.991178:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125842560:12345-0@lo:503: 00000100:00100000:1.0:1787692292.992278:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125842560:12345-0@lo:503: Request processed in 1097us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692292.992289:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787692292.992438:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125842560:0@lo:503: 00000100:00100000:0.0:1787692292.993027:0:8077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8077:1874531125842688:0@lo:502: 00000100:00100000:0.0:1787692292.993084:0:8077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692292.993153:0:8077:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a463c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692292.993375:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125842688 00000100:00100000:3.0:1787692292.993381:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125842688 00000100:00100000:3.0:1787692292.993445:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787692292.993453:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:8077:x1874531125842688:12345-0@lo:502: 00000100:00100000:3.0:1787692292.993722:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:8077:x1874531125842688:12345-0@lo:502: Request processed in 269us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692292.993729:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787692292.994377:0:8077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8077:1874531125842688:0@lo:502: 00000020:01000000:1.0:1787692292.994407:0:8077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787692292.994414:0:8077:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787692292.994422:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692292.994424:0:8077:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787692292.994428:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787692292.994431:0:8077:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.127@tcp to nid 0x20000c0a8ce7f (192.168.206.127@tcp) 00000020:01000000:1.0:1787692292.994451:0:8077:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787692292.994454:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787692292.994466:0:8077:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff92eb851419b8) 00000020:00000080:1.0:1787692292.994483:0:8077:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787692292.994488:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787692292.994559:0:8077:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787692292.994565:0:8077:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787692292.994570:0:8077:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09de26f 00010000:00080000:1.0:1787692292.994595:0:8077:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92ecb4d3f000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.127@tcp at head 00010000:00010000:1.0:1787692292.996327:0:8077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1787692293.001105:0:8077:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1787692293.001124:0:8077:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787692293.003126:0:8077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787692293.003599:0:8077:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787692293.003650:0:8077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1787692293.003703:0:8077:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787692293.004420:0:8078:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787692293.004426:0:8078:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1787692293.005637:0:8077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787692293.005650:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787692293.005684:0:8077:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787692293.005706:0:8077:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d8b8560a09de276 00000100:00080000:0.0:1787692293.005717:0:8077:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787692293.005722:0:8077:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92ecb4d3f000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:0.0:1787692293.005756:0:8077:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecafba6a00 x1874531125842816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787692293.005927:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125842816:0@lo:8: 00000100:00100000:2.0:1787692293.005997:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787692293.006157:0:8077:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787692293.006216:0:8077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787692293.006230:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692293.006231:0:8077:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787692293.006235:0:8077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787692293.006240:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692293.006241:0:8077:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787692293.006243:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787692293.006245:0:8077:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787692293.006269:0:8077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8077:1874531125842944:0@lo:502: 00000100:00100000:0.0:1787692293.006314:0:8077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692293.006329:0:8077:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a46180 going to sleep for 11 seconds 00000100:00100000:1.0:1787692293.006516:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125842816 00000100:00100000:1.0:1787692293.006523:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125842816 00000100:00100000:3.0:1787692293.006555:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125843200:0@lo:400: 00000100:00100000:1.0:1787692293.006555:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787692293.006562:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874531125842816:12345-0@lo:8: 00000100:00100000:3.0:1787692293.006584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787692293.006584:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000100:00100000:3.0:1787692293.006607:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00000080:1.0:1787692293.006610:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d8b8560a09de27d 00000100:00100000:3.0:1787692293.006612:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125843072:0@lo:400: 00002000:00100000:1.0:1787692293.006621:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff92ecb4d3b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787692293.006625:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787692293.006629:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1787692293.006630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692293.006653:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125843328:0@lo:400: 00000100:00100000:3.0:1787692293.006672:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692293.006689:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787692293.006693:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125843456:0@lo:400: 00000100:00100000:3.0:1787692293.006712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692293.006737:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125843200 00000100:00100000:3.0:1787692293.006740:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125843200 00002000:00100000:1.0:1787692293.006740:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787692293.006900:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787692293.006928:0:6680:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d3b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787692293.007031:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125842944 00000100:00100000:0.0:1787692293.007036:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125842944 00000100:00100000:0.0:1787692293.007145:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787692293.007153:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:8077:x1874531125842944:12345-0@lo:502: 00000100:00100000:0.0:1787692293.007351:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:8077:x1874531125842944:12345-0@lo:502: Request processed in 198us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692293.007358:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787692293.007505:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125843072 00000100:00100000:3.0:1787692293.007509:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125843072 00000100:00100000:3.0:1787692293.007521:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125843456 00000100:00100000:3.0:1787692293.007524:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125843456 00000100:00100000:3.0:1787692293.007543:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787692293.007550:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125843200:12345-0@lo:400: 00000100:00100000:3.0:1787692293.007589:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125843200:12345-0@lo:400: Request processed in 39us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692293.007601:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787692293.007616:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787692293.007622:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125843072:12345-0@lo:400: 00000100:00100000:3.0:1787692293.007648:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125843072:12345-0@lo:400: Request processed in 27us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692293.007654:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787692293.007664:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787692293.007669:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125843456:12345-0@lo:400: 00000100:00100000:3.0:1787692293.007697:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125843456:12345-0@lo:400: Request processed in 27us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692293.007702:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787692293.007721:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787692293.007727:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:3.0:1787692293.007741:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692293.008143:0:8077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8077:1874531125842944:0@lo:502: 00000020:01000000:0.0:1787692293.008176:0:8077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787692293.008183:0:8077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692293.008185:0:8077:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787692293.008189:0:8077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787692293.008251:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787692293.008267:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787692293.008275:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de261 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692293.008286:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de261 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692293.008307:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787692293.008310:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92ec87fd3370 from 1 10000000:01000000:0.0:1787692293.008312:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787692293.008338:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692293.008347:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692293.008355:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692293.008370:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125843584:0@lo:101: 00010000:00080000:3.0:1787692293.008509:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecae9fd180 x1874531125843456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692293.008522:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125843456:0@lo:400: 00010000:00080000:3.0:1787692293.008546:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecae9ffb80 x1874531125843072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692293.008555:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125843072:0@lo:400: 00010000:00080000:3.0:1787692293.008564:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecae9fdc00 x1874531125843200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692293.008571:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125843200:0@lo:400: 00000100:00100000:0.0:1787692293.008731:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692293.008980:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a46180 going to sleep for 11 seconds 00000100:00100000:3.0:1787692293.009158:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125843584 00000100:00100000:3.0:1787692293.009170:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125843584 00000100:00100000:3.0:1787692293.009207:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787692293.009215:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125843584:12345-0@lo:101: 00010000:00010000:3.0:1787692293.009226:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692293.009239:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec80031000/0x5d8b8560a09de28b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de284 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692293.009261:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec80031000/0x5d8b8560a09de28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de284 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692293.009271:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec80031000/0x5d8b8560a09de28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de284 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692293.009280:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec80031000, rc 0) 00000100:00100000:3.0:1787692293.009509:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125843584:12345-0@lo:101: Request processed in 294us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692293.009517:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787692293.009587:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125843584:0@lo:101: 00010000:00010000:0.0:1787692293.009601:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de28b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692293.009610:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de28b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692293.009657:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125843712:0@lo:501: 00000100:00100000:0.0:1787692293.009682:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692293.009741:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a46180 going to sleep for 11 seconds 00000100:00100000:3.0:1787692293.010224:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125843712 00000100:00100000:3.0:1787692293.010229:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125843712 00000100:00100000:3.0:1787692293.010291:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787692293.010299:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125843712:12345-0@lo:501: 00000100:00100000:3.0:1787692293.010547:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125843712:12345-0@lo:501: Request processed in 249us (864us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787692293.010555:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787692293.010672:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125843712:0@lo:501: 00000100:00100000:1.0:1787692293.010692:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874531125842816:12345-0@lo:8: Request processed in 4129us (4694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692293.010700:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:01000000:0.0:1787692293.010701:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787692293.010714:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de28b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692293.010715:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125843328 00000100:00100000:1.0:1787692293.010719:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125843328 00010000:00010000:0.0:1787692293.010722:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de28b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692293.010754:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787692293.010760:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125843328:12345-0@lo:400: 00000100:00100000:1.0:1787692293.010807:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125843328:12345-0@lo:400: Request processed in 47us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692293.010830:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787692293.011004:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecae9fce00 x1874531125843328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692293.011016:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125843328:0@lo:400: 00000100:00080000:3.0:1787692293.011192:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787692293.011559:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecafba6a00 x1874531125842816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787692303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692293.011581:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787692293.011590:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787692293.011597:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787692293.011602:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787692293.011605:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d3f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787692293.011613:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787692293.011619:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125842816:0@lo:8: 00000004:00080000:3.0:1787692293.011847:0:8078:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787692293.012373:0:8078:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 199218559425ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787692293.048704:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787692293.049041:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125843840:0@lo:13: 00000100:00100000:0.0:1787692293.049137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692293.049216:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125843840 00000100:00100000:1.0:1787692293.049223:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125843840 00000100:00100000:1.0:1787692293.049282:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787692293.049290:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874531125843840:12345-0@lo:13: 00002000:00000024:1.0:1787692293.049321:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:3.0:1787692293.049601:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787692293.049611:0:8079:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787692293.049644:0:8079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8079:1874531125843968:0@lo:7: 00000100:00100000:3.0:1787692293.049674:0:8079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692293.050169:0:8079:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692293.052259:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125843968 00000100:00100000:2.0:1787692293.052273:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125843968 00000100:00100000:2.0:1787692293.052340:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787692293.052350:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8079:x1874531125843968:12345-0@lo:7: 00000100:00100000:1.0:1787692293.054424:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874531125843840:12345-0@lo:13: Request processed in 5125us (5278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692293.054438:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787692293.054610:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecae9fdc00 x1874531125843840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692293.054635:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125843840:0@lo:13: 00002000:00080000:2.0:1787692293.060142:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787692293.060152:0:6680:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787692293.060618:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8079:x1874531125843968:12345-0@lo:7: Request processed in 8265us (10937us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692293.060629:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787692293.061686:0:8079:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecae9ffb80 x1874531125843968/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787692309 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692293.061704:0:8079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8079:1874531125843968:0@lo:7: 00000004:00080000:3.0:1787692293.061717:0:8079:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787692293.061753:0:8079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8079:1874531125844096:0@lo:5: 00000100:00100000:3.0:1787692293.061799:0:8079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692293.061894:0:8079:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692293.062235:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125844096 00000100:00100000:0.0:1787692293.062243:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125844096 00000100:00100000:0.0:1787692293.062285:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787692293.062295:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8079:x1874531125844096:12345-0@lo:5: 00002000:00080000:0.0:1787692293.062320:0:6681:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1787692293.062324:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1787692293.062646:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8079:x1874531125844096:12345-0@lo:5: Request processed in 351us (844us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787692293.062654:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787692293.062846:0:8079:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecae9ffb80 x1874531125844096/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787692309 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692293.062871:0:8079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ffb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8079:1874531125844096:0@lo:5: 00000004:00080000:3.0:1787692293.062882:0:8079:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787692293.062909:0:8079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8079:1874531125844224:0@lo:700: 00000100:00100000:3.0:1787692293.062938:0:8079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692293.062957:0:8079:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692293.063254:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125844224 00000100:00100000:0.0:1787692293.063260:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125844224 00000100:00100000:0.0:1787692293.063298:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787692293.063321:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8079:x1874531125844224:12345-0@lo:700: 00000100:00100000:0.0:1787692293.063352:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6687:1874531125844352:0@lo:700: 00000100:00100000:0.0:1787692293.063381:0:6687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692293.063407:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a46180 going to sleep for 11 seconds 00000100:00100000:2.0:1787692293.063603:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125844352 00000100:00100000:2.0:1787692293.063608:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125844352 00000100:00100000:2.0:1787692293.063645:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787692293.063653:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6687:x1874531125844352:12345-0@lo:700: 40000000:02000000:1.0:1787692293.121220:0:5838:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787692293.133447:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6687:x1874531125844352:12345-0@lo:700: Request processed in 69788us (70058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692293.133467:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787692293.133759:0:6687:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecafba6a00 x1874531125844352/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787692309 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692293.133774:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6687:1874531125844352:0@lo:700: 40000000:02000000:0.0:1787692293.133788:0:6687:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1787692293.213977:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1787692293.214001:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787692293.214426:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8079:x1874531125844224:12345-0@lo:700: Request processed in 151101us (151481us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692293.214439:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787692293.214549:0:8079:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecae9fe300 x1874531125844224/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787692309 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692293.214561:0:8079:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787692293.214578:0:8079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8079:1874531125844224:0@lo:700: 00000004:02000040:2.0:1787692293.237125:0:8079:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1787692293.240745:0:8079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8079:1874531125844480:0@lo:5: 00000100:00100000:3.0:1787692293.241042:0:8079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692293.241260:0:8079:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787692293.241347:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125844480 00000100:00100000:1.0:1787692293.241354:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125844480 00000100:00100000:1.0:1787692293.241447:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787692293.241456:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8079:x1874531125844480:12345-0@lo:5: 00002000:00080000:2.0:1787692293.246945:0:6679:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787692293.246967:0:6679:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787692293.254866:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8079:x1874531125844480:12345-0@lo:5: Request processed in 13399us (13813us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787692293.254880:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787692293.255318:0:8079:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecae9fe300 x1874531125844480/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787692309 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692293.255336:0:8079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8079:1874531125844480:0@lo:5: 00000004:00080000:1.0:1787692293.255353:0:8079:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787692293.633455:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692294.466548:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692294.470218:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125844608:0@lo:13: 00000100:00100000:0.0:1787692294.470301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692294.470482:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125844608 00000100:00100000:1.0:1787692294.470491:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125844608 00000100:00100000:1.0:1787692294.470551:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787692294.470561:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125844608:12345-0@lo:13: 00002000:00000024:1.0:1787692294.470601:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692294.470661:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125844608:12345-0@lo:13: Request processed in 102us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692294.470669:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787692294.470725:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec88aa1f80 x1874531125844608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692294.470746:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125844608:0@lo:13: 00010000:00010000:1.0:1787692294.667908:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787692295.617273:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787692295.682475:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692296.706301:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692297.249988:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692297.250146:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107996032 00000100:00100000:3.0:1787692297.250162:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107996032 00000100:00100000:3.0:1787692297.250232:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 110 00000100:00100000:3.0:1787692297.250241:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2360:x1874531107996032:12345-192.168.206.27@tcp:250: 00010000:00080000:3.0:1787692297.250287:0:5823:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0696784b-1191-4b0f-b755-3a72c69e021b@192.168.206.27@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:3.0:1787692297.250320:0:5823:0:(genops.c:1385:class_connect()) connect: client 0696784b-1191-4b0f-b755-3a72c69e021b, cookie 0x5d8b8560a09de292 00000100:00080000:3.0:1787692297.250879:0:5823:0:(import.c:65:import_set_state_nolock()) ffff92eb86da6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787692297.250972:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+5:2360:x1874531107996032:12345-192.168.206.27@tcp:250: Request processed in 729us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692297.250981:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 110 00000100:00100000:0.0:1787692297.256019:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692297.256771:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107995904 00000100:00100000:3.0:1787692297.256784:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107995904 00000100:00100000:3.0:1787692297.256894:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 111 00000100:00100000:3.0:1787692297.256906:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+5:5587:x1874531107995904:12345-192.168.206.27@tcp:101: 00010000:00010000:3.0:1787692297.256926:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692297.256958:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec80030a00/0x5d8b8560a09de299 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b210f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692297.256995:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec80030a00/0x5d8b8560a09de299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b210f expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692297.257007:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec80030a00/0x5d8b8560a09de299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b210f expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692297.257048:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec80030a00, rc 0) 00000100:00100000:3.0:1787692297.257133:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+6:5587:x1874531107995904:12345-192.168.206.27@tcp:101: Request processed in 229us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692297.257140:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 111 00000100:00100000:0.0:1787692297.264881:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692297.265257:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107996160 00000100:00100000:3.0:1787692297.265270:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107996160 00000100:00100000:3.0:1787692297.265339:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 112 00000100:00100000:3.0:1787692297.265351:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+6:5587:x1874531107996160:12345-192.168.206.27@tcp:501: 00000100:00100000:3.0:1787692297.266920:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+6:5587:x1874531107996160:12345-192.168.206.27@tcp:501: Request processed in 1558us (2039us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787692297.266934:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 112 00000100:00100000:2.0:1787692297.289715:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692297.289905:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107996288 00000100:00100000:0.0:1787692297.289916:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107996288 00000100:00100000:0.0:1787692297.289997:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 113 00000100:00100000:0.0:1787692297.290009:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+6:5587:x1874531107996288:12345-192.168.206.27@tcp:101: 00010000:00010000:0.0:1787692297.290026:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692297.290043:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6425000/0x5d8b8560a09de2a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2116 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692297.290100:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6425000/0x5d8b8560a09de2a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2116 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692297.290112:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6425000/0x5d8b8560a09de2a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2116 expref: 7 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692297.290121:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425000, rc 0) 00000100:00100000:0.0:1787692297.290186:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+7:5587:x1874531107996288:12345-192.168.206.27@tcp:101: Request processed in 181us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692297.290194:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 113 00000100:00100000:0.0:1787692297.308772:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692297.308871:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107996416 00000100:00100000:3.0:1787692297.308882:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107996416 00000100:00100000:3.0:1787692297.308934:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 114 00000100:00100000:3.0:1787692297.308943:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+7:5587:x1874531107996416:12345-192.168.206.27@tcp:501: 00000100:00100000:3.0:1787692297.309264:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+8:5587:x1874531107996416:12345-192.168.206.27@tcp:501: Request processed in 321us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692297.309273:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 114 00000100:00100000:1.0:1787692297.315320:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692297.315618:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107996544 00000100:00100000:3.0:1787692297.315628:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107996544 00000100:00100000:3.0:1787692297.315683:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 115 00000100:00100000:3.0:1787692297.315693:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+8:5587:x1874531107996544:12345-192.168.206.27@tcp:503: 00000100:00100000:3.0:1787692297.316409:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+8:5587:x1874531107996544:12345-192.168.206.27@tcp:503: Request processed in 714us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692297.316429:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 115 00000100:00100000:2.0:1787692297.336237:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692297.340041:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107996672 00000100:00100000:0.0:1787692297.340059:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107996672 00000100:00100000:0.0:1787692297.340213:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 116 00000100:00100000:0.0:1787692297.340226:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+8:5605:x1874531107996672:12345-192.168.206.27@tcp:502: 00000100:00100000:0.0:1787692297.343521:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+8:5605:x1874531107996672:12345-192.168.206.27@tcp:502: Request processed in 3284us (7279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692297.343535:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 116 00000100:00100000:0.0:1787692297.411346:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692297.412552:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107996800 00000100:00100000:3.0:1787692297.412569:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107996800 00000100:00100000:3.0:1787692297.412779:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 117 00000100:00100000:3.0:1787692297.412794:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+8:5605:x1874531107996800:12345-192.168.206.27@tcp:502: 00000100:00100000:2.0:1787692297.423637:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+8:5605:x1874531107996800:12345-192.168.206.27@tcp:502: Request processed in 10823us (12283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692297.423659:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 117 00000100:00100000:1.0:1787692297.442203:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692297.442550:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107996928 00000100:00100000:0.0:1787692297.442565:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107996928 00000100:00100000:0.0:1787692297.442658:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 118 00000100:00100000:0.0:1787692297.442671:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+8:5587:x1874531107996928:12345-192.168.206.27@tcp:101: 00010000:00010000:0.0:1787692297.442860:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692297.442883:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6425400/0x5d8b8560a09de2a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2140 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692297.442946:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6425400/0x5d8b8560a09de2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2140 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692297.442960:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6425400/0x5d8b8560a09de2a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2140 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692297.442972:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425400, rc 0) 00000100:00100000:0.0:1787692297.443129:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+9:5587:x1874531107996928:12345-192.168.206.27@tcp:101: Request processed in 460us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692297.443137:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 118 00000100:00100000:1.0:1787692297.446582:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692297.446882:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107997056 00000100:00100000:2.0:1787692297.446894:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107997056 00000100:00100000:2.0:1787692297.446962:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 119 00000100:00100000:2.0:1787692297.446974:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+9:5587:x1874531107997056:12345-192.168.206.27@tcp:256: 20000000:01000000:2.0:1787692297.447017:0:5826:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787692297.447058:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787692297.447063:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787692297.447067:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787692297.447079:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787692297.456164:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+9:5587:x1874531107997056:12345-192.168.206.27@tcp:256: Request processed in 9177us (9580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692297.456183:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 119 00000100:00100000:1.0:1787692297.460397:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692297.460492:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107997184 00000100:00100000:0.0:1787692297.460505:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107997184 00000100:00100000:0.0:1787692297.460591:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 120 00000100:00100000:0.0:1787692297.460604:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+9:5587:x1874531107997184:12345-192.168.206.27@tcp:101: 00010000:00010000:0.0:1787692297.460800:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692297.460894:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de2ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2147 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692297.460931:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de2ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2147 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692297.460944:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de2ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2147 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692297.460978:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425a00, rc 0) 00000100:00100000:0.0:1787692297.461299:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:5587:x1874531107997184:12345-192.168.206.27@tcp:101: Request processed in 696us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692297.461308:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 120 00000100:00100000:1.0:1787692297.467930:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692297.469128:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107997312 00000100:00100000:0.0:1787692297.469143:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107997312 00000100:00100000:0.0:1787692297.469236:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 121 00000100:00100000:0.0:1787692297.469259:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+10:5587:x1874531107997312:12345-192.168.206.27@tcp:501: 00000100:00100000:0.0:1787692297.469645:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+10:5587:x1874531107997312:12345-192.168.206.27@tcp:501: Request processed in 396us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692297.469654:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 121 00000100:00100000:2.0:1787692297.472675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692297.473026:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107997440 00000100:00100000:0.0:1787692297.473048:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107997440 00000100:00100000:0.0:1787692297.473138:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 122 00000100:00100000:0.0:1787692297.473151:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:5587:x1874531107997440:12345-192.168.206.27@tcp:503: 00000100:00100000:0.0:1787692297.474256:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:5587:x1874531107997440:12345-192.168.206.27@tcp:503: Request processed in 1091us (1575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692297.474269:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 122 00000100:00100000:1.0:1787692297.481124:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692297.481222:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107997568 00000100:00100000:3.0:1787692297.481235:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107997568 00000100:00100000:3.0:1787692297.481315:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 123 00000100:00100000:3.0:1787692297.481327:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+10:5611:x1874531107997568:12345-192.168.206.27@tcp:502: 00000100:00100000:3.0:1787692297.481657:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+10:5611:x1874531107997568:12345-192.168.206.27@tcp:502: Request processed in 332us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692297.481666:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 123 00000100:00100000:1.0:1787692297.487306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692297.487599:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107997696 00000100:00100000:0.0:1787692297.487611:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107997696 00000100:00100000:0.0:1787692297.487926:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 124 00000100:00100000:0.0:1787692297.487939:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:5611:x1874531107997696:12345-192.168.206.27@tcp:502: 00000100:00100000:0.0:1787692297.488590:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:5611:x1874531107997696:12345-192.168.206.27@tcp:502: Request processed in 651us (1295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692297.488612:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 124 00000100:00100000:0.0:1787692297.497986:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692297.498125:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107997824 00000100:00100000:3.0:1787692297.498139:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107997824 00000100:00100000:3.0:1787692297.498204:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:3.0:1787692297.498212:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1874531107997824:12345-192.168.206.27@tcp:38: 00010000:00080000:3.0:1787692297.498243:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:3.0:1787692297.498294:0:5832:0:(genops.c:1385:class_connect()) connect: client 067f46f5-4779-40e6-b53d-5b3e89751501, cookie 0x5d8b8560a09de2b5 00000004:00100000:3.0:1787692297.498325:0:5832:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1787692297.498331:0:5832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1787692297.619433:0:5832:0:(import.c:65:import_set_state_nolock()) ffff92eb86da1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787692297.619541:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:2360:x1874531107997824:12345-192.168.206.27@tcp:38: Request processed in 121326us (121568us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692297.619554:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00010000:00010000:0.0:1787692297.729139:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692298.052591:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125845120:0@lo:400: 00000100:00100000:1.0:1787692298.052696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692298.052781:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787692298.052808:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125844992:0@lo:400: 00000100:00100000:1.0:1787692298.052902:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692298.052941:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125845120 00000100:00100000:1.0:1787692298.052950:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125845120 00000100:00100000:1.0:1787692298.053018:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787692298.053029:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125845120:12345-0@lo:400: 00000100:00080000:2.0:1787692298.053178:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787692298.053194:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125844992 00000100:00100000:2.0:1787692298.053198:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125844992 00000100:00100000:2.0:1787692298.053246:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787692298.053254:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125844992:12345-0@lo:400: 00000100:00100000:2.0:1787692298.053318:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125844992:12345-0@lo:400: Request processed in 65us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692298.053326:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787692298.053349:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692298.053450:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125844864:0@lo:400: 00000100:00100000:3.0:1787692298.053495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692298.053524:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125845376:0@lo:400: 00000100:00100000:3.0:1787692298.053549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692298.053577:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787692298.053584:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125844736:0@lo:400: 00000100:00100000:3.0:1787692298.053614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692298.053632:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125845248:0@lo:400: 00000100:00100000:3.0:1787692298.053654:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692298.053679:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125845376 00000100:00100000:3.0:1787692298.053683:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125845376 00000100:00100000:3.0:1787692298.053715:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787692298.053722:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125845376:12345-0@lo:400: 00000100:00100000:3.0:1787692298.053757:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125845376:12345-0@lo:400: Request processed in 36us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692298.053763:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787692298.053784:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787692298.053791:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125844864 00000100:00100000:3.0:1787692298.053794:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125844864 00000100:00100000:3.0:1787692298.053833:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125845248 00000100:00100000:3.0:1787692298.053836:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125845248 00000100:00100000:3.0:1787692298.053859:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787692298.053865:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125844864:12345-0@lo:400: 00000100:00100000:3.0:1787692298.053894:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125844864:12345-0@lo:400: Request processed in 30us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692298.053901:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787692298.053912:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787692298.053918:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125845248:12345-0@lo:400: 00000100:00100000:3.0:1787692298.053955:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125845248:12345-0@lo:400: Request processed in 37us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692298.053962:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1787692298.053976:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787692298.054007:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecafba0380 x1874531125845248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692298.054023:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125845248:0@lo:400: 00000100:00100000:2.0:1787692298.054156:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125844736 00000100:00100000:2.0:1787692298.054161:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125844736 00000100:00100000:2.0:1787692298.054192:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787692298.054199:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125844736:12345-0@lo:400: 00000100:00100000:2.0:1787692298.054235:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125844736:12345-0@lo:400: Request processed in 36us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692298.054252:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:3.0:1787692298.054329:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecafba2d80 x1874531125844864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692298.054342:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125844864:0@lo:400: 00010000:00080000:3.0:1787692298.054358:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecafba0000 x1874531125845376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692298.054365:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787692298.054380:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125845376:0@lo:400: 00000100:00100000:3.0:1787692298.054400:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125844736:0@lo:400: 00010000:00080000:3.0:1787692298.054438:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecafba2300 x1874531125844992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692298.054447:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125844992:0@lo:400: 00000100:00100000:1.0:1787692298.054652:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125845120:12345-0@lo:400: Request processed in 1623us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692298.054661:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787692298.054869:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecafba1c00 x1874531125845120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692298.054879:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125845120:0@lo:400: 00000100:00100000:0.0:1787692298.561866:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125845504:0@lo:13: 00000100:00100000:0.0:1787692298.561962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692298.562313:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125845504 00000100:00100000:2.0:1787692298.562329:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125845504 00000100:00100000:2.0:1787692298.562394:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787692298.562403:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125845504:12345-0@lo:13: 00002000:00000024:2.0:1787692298.562438:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692298.562895:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125845504:12345-0@lo:13: Request processed in 491us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692298.562903:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787692298.562995:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecafba1c00 x1874531125845504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692298.564262:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125845504:0@lo:13: 00000100:00100000:1.0:1787692298.633430:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692298.633482:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692298.633569:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107997952 00000100:00100000:3.0:1787692298.633588:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107997952 00000100:00100000:2.0:1787692298.633606:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107998080 00000100:00100000:2.0:1787692298.633618:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107998080 00000100:00100000:2.0:1787692298.633699:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:2.0:1787692298.633715:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:5587:x1874531107998080:12345-192.168.206.27@tcp:41: 00000100:00080000:0.0:1787692298.633751:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1787692298.633769:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787692298.633871:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:5587:x1874531107998080:12345-192.168.206.27@tcp:41: Request processed in 163us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692298.644491:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692298.644731:0:5832:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787692298.644745:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787692298.647633:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:3.0:1787692298.647645:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107998208 00000100:00100000:3.0:1787692298.647660:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107998208 00000100:00100000:2.0:1787692298.647688:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:2.0:1787692298.647708:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:0:x1874531107997952:12345-192.168.206.27@tcp:41: 00000004:00000024:2.0:1787692298.647742:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787692298.648023:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:1.0:1787692298.648036:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:5587:x1874531107998208:12345-192.168.206.27@tcp:40: 00000100:00100000:1.0:1787692298.648135:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:5587:x1874531107998208:12345-192.168.206.27@tcp:40: Request processed in 102us (3660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692298.648143:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:2.0:1787692298.650260:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:0:x1874531107997952:12345-192.168.206.27@tcp:41: Request processed in 2552us (16830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692298.650275:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:1.0:1787692298.654309:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692298.655288:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107998592 00000100:00100000:2.0:1787692298.655306:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107998592 00000100:00100000:2.0:1787692298.655377:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:2.0:1787692298.655403:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:5587:x1874531107998592:12345-192.168.206.27@tcp:33: 00000100:00100000:2.0:1787692298.655970:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692298.655998:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692298.656029:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692298.656054:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107998336 00000100:00100000:2.0:1787692298.656059:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107998336 00000100:00100000:2.0:1787692298.656098:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107998464 00000100:00100000:2.0:1787692298.656101:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107998464 00000100:00100000:2.0:1787692298.656127:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:2.0:1787692298.656134:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1874531107998336:12345-192.168.206.27@tcp:8: 00010000:00080000:2.0:1787692298.656173:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:2.0:1787692298.656207:0:6680:0:(genops.c:1385:class_connect()) connect: client 067f46f5-4779-40e6-b53d-5b3e89751501, cookie 0x5d8b8560a09de2bc 00000100:00100000:1.0:1787692298.656217:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00002000:00100000:2.0:1787692298.656221:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 067f46f5-4779-40e6-b53d-5b3e89751501/ffff92ecb4d56000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1787692298.656246:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1874531107998464:12345-192.168.206.27@tcp:8: 00002000:00100000:2.0:1787692298.656247:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00080000:1.0:1787692298.656292:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:1.0:1787692298.656341:0:6679:0:(genops.c:1385:class_connect()) connect: client 067f46f5-4779-40e6-b53d-5b3e89751501, cookie 0x5d8b8560a09de2c3 00002000:00100000:1.0:1787692298.656354:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 067f46f5-4779-40e6-b53d-5b3e89751501/ffff92ecb4d3e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787692298.656368:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787692298.656860:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107998720 00000100:00100000:3.0:1787692298.656869:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107998720 00000100:00100000:3.0:1787692298.656919:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 126 00000100:00100000:3.0:1787692298.656930:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531107998720:12345-192.168.206.27@tcp:400: 00002000:00080000:1.0:1787692298.656954:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1787692298.657011:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531107998720:12345-192.168.206.27@tcp:400: Request processed in 81us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692298.657022:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 126 00000100:00080000:1.0:1787692298.657029:0:6679:0:(import.c:65:import_set_state_nolock()) ffff92ecc561e000 : changing import state from RECOVER to FULL 00002000:00080000:2.0:1787692298.657035:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787692298.657081:0:6680:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d52000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787692298.657114:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2360:x1874531107998464:12345-192.168.206.27@tcp:8: Request processed in 880us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692298.657131:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:2.0:1787692298.657134:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:2360:x1874531107998336:12345-192.168.206.27@tcp:8: Request processed in 991us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692298.657146:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00000004:00080000:2.0:1787692298.700606:0:5834:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 45130us 00000004:00200000:2.0:1787692298.744553:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787692298.745083:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:5587:x1874531107998592:12345-192.168.206.27@tcp:33: Request processed in 89675us (90778us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692298.745097:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00010000:00010000:1.0:1787692298.753653:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692299.068261:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692299.068353:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107998848 00000100:00100000:3.0:1787692299.068513:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107998848 00000100:00100000:3.0:1787692299.068650:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:3.0:1787692299.068661:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:5628:x1874531107998848:12345-192.168.206.27@tcp:101: 00010000:00010000:3.0:1787692299.068681:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692299.072335:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de2ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2171 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692299.072486:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de2d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692299.072500:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692299.072514:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692299.072702:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787692299.072707:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787692299.073137:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de2d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692299.073168:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de2ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2171 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692299.073186:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de2d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2171 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692299.073194:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692299.073197:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787692299.073201:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35b600, rc 0) 00000100:00100000:3.0:1787692299.073270:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:5628:x1874531107998848:12345-192.168.206.27@tcp:101: Request processed in 4610us (5019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692299.073279:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00000001:00100000:2.0:1787692299.182232:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 067f46f5-4779-40e6-b53d-5b3e89751501 00000100:00100000:3.0:1787692299.585149:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125845632:0@lo:13: 00000100:00100000:3.0:1787692299.585227:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692299.585836:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125845632 00000100:00100000:1.0:1787692299.585844:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125845632 00000100:00100000:1.0:1787692299.585898:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787692299.585909:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125845632:12345-0@lo:13: 00002000:00000024:1.0:1787692299.585932:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692299.585990:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125845632:12345-0@lo:13: Request processed in 83us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692299.585998:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787692299.586364:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec88aa1c00 x1874531125845632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692299.586385:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125845632:0@lo:13: 00010000:00010000:0.0:1787692299.777938:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692300.801136:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692301.285579:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692301.285734:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107998976 00000100:00100000:3.0:1787692301.285747:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107998976 00000100:00100000:3.0:1787692301.285847:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:3.0:1787692301.285862:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+7:5680:x1874531107998976:12345-192.168.206.27@tcp:41: 00000004:00000024:3.0:1787692301.285917:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787692301.286000:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+7:5680:x1874531107998976:12345-192.168.206.27@tcp:41: Request processed in 142us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692301.286029:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00080000:0.0:1787692301.286632:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692301.289910:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692301.290029:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107999104 00000100:00100000:0.0:1787692301.290041:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107999104 00000100:00080000:3.0:1787692301.290310:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787692301.290350:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:0.0:1787692301.290363:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:067f46f5-4779-40e6-b53d-5b3e89751501+5:5680:x1874531107999104:12345-192.168.206.27@tcp:13: 00002000:00000024:0.0:1787692301.290411:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692301.290793:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:067f46f5-4779-40e6-b53d-5b3e89751501+5:5680:x1874531107999104:12345-192.168.206.27@tcp:13: Request processed in 431us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692301.290803:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:1.0:1787692301.293004:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692301.294722:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107999232 00000100:00100000:2.0:1787692301.294738:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107999232 00000100:00100000:2.0:1787692301.294875:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:2.0:1787692301.294889:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:067f46f5-4779-40e6-b53d-5b3e89751501+6:5680:x1874531107999232:12345-192.168.206.27@tcp:13: 00000100:00080000:3.0:1787692301.294914:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1787692301.294940:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692301.295025:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:067f46f5-4779-40e6-b53d-5b3e89751501+6:5680:x1874531107999232:12345-192.168.206.27@tcp:13: Request processed in 140us (2045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692301.295033:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00010000:00010000:3.0:1787692301.827917:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787692302.224078:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 067f46f5-4779-40e6-b53d-5b3e89751501 00000001:00100000:3.0:1787692302.753987:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 067f46f5-4779-40e6-b53d-5b3e89751501 00010000:00010000:1.0:1787692302.852933:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692303.169208:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125846144:0@lo:400: 00000100:00100000:3.0:1787692303.169311:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692303.169395:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787692303.169402:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125846016:0@lo:400: 00000100:00100000:3.0:1787692303.169431:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692303.169468:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125846144 00000100:00100000:3.0:1787692303.169478:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125846144 00000100:00100000:3.0:1787692303.169547:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787692303.169559:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125846144:12345-0@lo:400: 00000100:00100000:3.0:1787692303.169621:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125846144:12345-0@lo:400: Request processed in 64us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692303.169629:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787692303.169652:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787692303.169682:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec878b2300 x1874531125846144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692303.169698:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125846144:0@lo:400: 00000100:00100000:1.0:1787692303.170078:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125845888:0@lo:400: 00000100:00100000:1.0:1787692303.170142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692303.170171:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125846400:0@lo:400: 00000100:00100000:1.0:1787692303.170194:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692303.170237:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787692303.170243:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125845760:0@lo:400: 00000100:00100000:1.0:1787692303.170270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692303.170295:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125846272:0@lo:400: 00000100:00100000:1.0:1787692303.170323:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692303.170353:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125846016 00000100:00100000:1.0:1787692303.170365:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125846016 00000100:00100000:1.0:1787692303.170410:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125845888 00000100:00100000:1.0:1787692303.170413:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125845888 00000100:00100000:1.0:1787692303.170425:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125846272 00000100:00100000:1.0:1787692303.170428:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125846272 00000100:00100000:1.0:1787692303.170444:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787692303.170450:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125846016:12345-0@lo:400: 00000100:00100000:1.0:1787692303.170493:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125846016:12345-0@lo:400: Request processed in 43us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692303.170499:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787692303.170515:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787692303.170521:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125845888:12345-0@lo:400: 00000100:00100000:1.0:1787692303.170552:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125845888:12345-0@lo:400: Request processed in 31us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692303.170557:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787692303.170569:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787692303.170574:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125846272:12345-0@lo:400: 00000100:00100000:1.0:1787692303.170599:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125846272:12345-0@lo:400: Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692303.170605:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787692303.170623:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125846400 00000100:00100000:1.0:1787692303.170627:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125846400 00000100:00100000:1.0:1787692303.170654:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787692303.170660:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125846400:12345-0@lo:400: 00000100:00100000:1.0:1787692303.170691:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125846400:12345-0@lo:400: Request processed in 32us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692303.170698:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787692303.170715:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125845760 00000100:00100000:1.0:1787692303.170726:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125845760 00000100:00100000:1.0:1787692303.170754:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1787692303.170965:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787692303.170971:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692303.171004:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125846016:0@lo:400: 00000100:00100000:2.0:1787692303.171062:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125846272:0@lo:400: 00000100:00100000:2.0:1787692303.171072:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125845888:0@lo:400: 00010000:00080000:2.0:1787692303.171082:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec878b2a00 x1874531125846400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692303.171092:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125846400:0@lo:400: 00000100:00100000:1.0:1787692303.171340:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125845760:12345-0@lo:400: 00000100:00100000:1.0:1787692303.171385:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125845760:12345-0@lo:400: Request processed in 625us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692303.171391:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1787692303.171668:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125845760:0@lo:400: 00000100:00100000:3.0:1787692303.682463:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125846528:0@lo:13: 00000100:00100000:3.0:1787692303.682536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692303.682655:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125846528 00000100:00100000:0.0:1787692303.682678:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125846528 00000100:00100000:0.0:1787692303.682738:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787692303.682749:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125846528:12345-0@lo:13: 00002000:00000024:0.0:1787692303.682783:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692303.682847:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125846528:12345-0@lo:13: Request processed in 101us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692303.682862:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787692303.682901:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf6e3800 x1874531125846528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692303.682920:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125846528:0@lo:13: 00010000:00010000:3.0:1787692303.873860:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692304.032746:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692304.032789:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692304.032809:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692304.032853:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692304.032893:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107999616 00000100:00100000:1.0:1787692304.032901:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107999616 00000100:00100000:1.0:1787692304.032948:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107999744 00000100:00100000:1.0:1787692304.032951:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107999744 00000100:00100000:1.0:1787692304.032969:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:1.0:1787692304.032979:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531107999616:12345-192.168.206.27@tcp:400: 00000100:00100000:1.0:1787692304.033057:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531107999616:12345-192.168.206.27@tcp:400: Request processed in 79us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692304.033065:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:1.0:1787692304.033082:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:1.0:1787692304.033089:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531107999744:12345-192.168.206.27@tcp:400: 00000100:00100000:1.0:1787692304.033112:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531107999744:12345-192.168.206.27@tcp:400: Request processed in 24us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692304.033119:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:2.0:1787692304.033489:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107999488 00000100:00100000:2.0:1787692304.033493:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107999488 00000100:00100000:2.0:1787692304.033536:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:2.0:1787692304.033544:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531107999488:12345-192.168.206.27@tcp:400: 00000100:00100000:2.0:1787692304.033580:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531107999488:12345-192.168.206.27@tcp:400: Request processed in 38us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692304.033594:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00080000:2.0:1787692304.033669:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787692304.033673:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787692304.033675:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787692304.033838:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107999360 00000100:00100000:0.0:1787692304.033843:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107999360 00000100:00100000:0.0:1787692304.033876:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 128 00000100:00100000:0.0:1787692304.033885:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531107999360:12345-192.168.206.27@tcp:400: 00000100:00100000:0.0:1787692304.033919:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531107999360:12345-192.168.206.27@tcp:400: Request processed in 36us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692304.033925:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 128 00000001:02000400:1.0:1787692304.521267:0:8285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787692304.705068:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125846656:0@lo:13: 00000100:00100000:3.0:1787692304.705152:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692304.705909:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125846656 00000100:00100000:0.0:1787692304.705918:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125846656 00000100:00100000:0.0:1787692304.705973:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787692304.705983:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125846656:12345-0@lo:13: 00002000:00000024:0.0:1787692304.706354:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692304.708771:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125846656:12345-0@lo:13: Request processed in 2781us (3609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692304.708783:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787692304.709361:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec88aa3100 x1874531125846656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692304.709382:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125846656:0@lo:13: 00010000:00010000:1.0:1787692304.897873:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692305.923635:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692306.946845:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692307.969908:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787692308.161496:0:8433:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff5acd8a80 20000000:00000080:0.0:1787692308.161514:0:8433:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92ecaf143c00 uarg=0000000000000000 20000000:01000000:0.0:1787692308.161603:0:8433:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1787692308.161605:0:8433:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1787692308.161607:0:8433:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787692308.161612:0:8433:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1787692308.161616:0:8433:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1787692308.161636:0:8433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787692308.161638:0:8433:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787692308.162276:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787692308.162280:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787692308.163964:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787692308.164566:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787692308.164618:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787692308.164675:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1787692308.164689:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787692308.164691:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787692308.165759:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787692308.166555:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787692308.166635:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787692308.166675:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1787692308.166809:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787692308.166834:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787692308.168790:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787692308.169345:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787692308.169412:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787692308.169451:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1787692308.169465:0:8433:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787692308.169468:0:8433:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787692308.170234:0:8437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1787692308.170761:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1787692308.170801:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1787692308.170934:0:8433:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1787692308.170951:0:8433:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787692308.170970:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.170987:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de1d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de1ce expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.170994:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de1ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de1f8 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171000:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ecc62ca000/0x5d8b8560a09de229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de222 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171029:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ecc62cb800/0x5d8b8560a09de237 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de230 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171036:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de23e expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171043:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ecc62caa00/0x5d8b8560a09de261 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de25a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171050:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec80031000/0x5d8b8560a09de28b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de284 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171059:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec80030a00/0x5d8b8560a09de299 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b210f expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171067:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92eca6425000/0x5d8b8560a09de2a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2116 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171191:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171229:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92eca6425000/0x5d8b8560a09de2a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2116 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171245:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92eca6425000/0x5d8b8560a09de2a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2116 expref: 9 pid: 5825 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692308.171260:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125846784:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692308.171407:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec80030a00/0x5d8b8560a09de299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b210f expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171427:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ec80030a00/0x5d8b8560a09de299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b210f expref: 9 pid: 5826 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692308.171438:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125846912:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692308.171473:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec80031000/0x5d8b8560a09de28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de284 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171481:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ec80031000/0x5d8b8560a09de28b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de284 expref: 18 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692308.171490:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847040:0@lo:104: 00000100:00100000:2.0:1787692308.171527:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787692308.171560:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ecc62caa00/0x5d8b8560a09de261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de25a expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171568:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ecc62caa00/0x5d8b8560a09de261 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de25a expref: 18 pid: 5823 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692308.171575:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847168:0@lo:104: 00000100:00100000:2.0:1787692308.171595:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692308.171646:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1787692308.171650:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de23e expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171657:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de245 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de23e expref: 18 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692308.171658:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125847040 00000100:00100000:0.0:1787692308.171664:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125847040 00000100:00100000:2.0:1787692308.171665:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847296:0@lo:104: 00000100:00100000:0.0:1787692308.171714:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125847168 00000100:00100000:0.0:1787692308.171717:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125847168 00000100:00100000:0.0:1787692308.171734:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787692308.171754:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+4:8433:x1874531125847040:12345-0@lo:104: 00010000:00010000:0.0:1787692308.171766:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de28b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692308.171771:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787692308.171793:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ecc62cb800/0x5d8b8560a09de237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de230 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.171802:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ecc62cb800/0x5d8b8560a09de237 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de230 expref: 18 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692308.171829:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847424:0@lo:104: 00010000:00010000:0.0:1787692308.171830:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787692308.171836:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+4:8433:x1874531125847040:12345-0@lo:104: Request processed in 96us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692308.171843:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787692308.171859:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125847296 00000100:00100000:0.0:1787692308.171862:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125847296 00000100:00100000:0.0:1787692308.171878:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787692308.171884:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+4:8433:x1874531125847168:12345-0@lo:104: 00010000:00010000:0.0:1787692308.171891:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de261 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692308.171907:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787692308.171930:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ecc62ca000/0x5d8b8560a09de229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de222 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.171933:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787692308.171937:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f7f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+4:8433:x1874531125847168:12345-0@lo:104: Request processed in 54us (342us total) trans 0 rc 0/0 00010000:00010000:2.0:1787692308.171939:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ecc62ca000/0x5d8b8560a09de229 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de222 expref: 18 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692308.171943:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787692308.171947:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847552:0@lo:104: 00000100:00100000:2.0:1787692308.171965:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692308.171975:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125847424 00000100:00100000:0.0:1787692308.171979:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125847424 00000100:00100000:0.0:1787692308.171992:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125847552 00000100:00100000:0.0:1787692308.171994:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125847552 00000100:00100000:0.0:1787692308.172004:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787692308.172010:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+5:8433:x1874531125847296:12345-0@lo:104: 00010000:00010000:0.0:1787692308.172027:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de245 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.172053:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787692308.172058:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+5:8433:x1874531125847296:12345-0@lo:104: Request processed in 49us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692308.172064:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787692308.172067:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de1ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de1f8 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.172075:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de1ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de1f8 expref: 18 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692308.172092:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847680:0@lo:104: 00000100:00100000:2.0:1787692308.172113:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787692308.172139:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de1ce expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.172148:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de1d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de1ce expref: 18 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692308.172156:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847808:0@lo:104: 00000100:00100000:2.0:1787692308.172185:0:8433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692308.172195:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4b8b300 going to sleep for 11 seconds 00000100:00100000:0.0:1787692308.172216:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125847680 00000100:00100000:0.0:1787692308.172220:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125847680 00000100:00100000:0.0:1787692308.172236:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125847808 00000100:00100000:0.0:1787692308.172237:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125847808 00000100:00100000:0.0:1787692308.172248:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787692308.172254:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+6:8433:x1874531125847424:12345-0@lo:104: 00010000:00010000:0.0:1787692308.172261:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de237 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692308.172466:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787692308.172476:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:74f850a3-c102-416a-ae3b-08438aa77de6+6:8433:x1874531125847552:12345-0@lo:104: 00010000:00010000:1.0:1787692308.172485:0:7620:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de229 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692308.172504:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847040:0@lo:104: 00010000:00010000:0.0:1787692308.172716:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1787692308.172722:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+6:8433:x1874531125847424:12345-0@lo:104: Request processed in 468us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692308.172734:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787692308.172762:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787692308.172772:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+5:8433:x1874531125847680:12345-0@lo:104: 00010000:00010000:0.0:1787692308.172780:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de1ff expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.172804:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1787692308.172808:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+5:8433:x1874531125847680:12345-0@lo:104: Request processed in 42us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692308.172874:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787692308.172888:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787692308.172896:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+4:8433:x1874531125847808:12345-0@lo:104: 00010000:00010000:0.0:1787692308.172904:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de1d5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.172930:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1787692308.172935:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+4:8433:x1874531125847808:12345-0@lo:104: Request processed in 42us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692308.172940:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787692308.173045:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787692308.173050:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de28b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692308.173842:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847168:0@lo:104: 00000100:00100000:2.0:1787692308.173855:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847296:0@lo:104: 00000100:00100000:2.0:1787692308.173862:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847424:0@lo:104: 00000100:00100000:2.0:1787692308.173869:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847680:0@lo:104: 00000100:00100000:2.0:1787692308.173875:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847808:0@lo:104: 00010000:00010000:1.0:1787692308.174064:0:7620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787692308.174072:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:74f850a3-c102-416a-ae3b-08438aa77de6+3:8433:x1874531125847552:12345-0@lo:104: Request processed in 1598us (2104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692308.174090:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787692308.174170:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125847552:0@lo:104: 00010000:00010000:0.0:1787692308.174349:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424400 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692308.174354:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de28b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.174378:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de28b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692308.174384:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de28b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692308.174389:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787692308.174547:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de28b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.174555:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787692308.174606:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1787692308.174626:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de28b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.174633:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92eca6424400/0x5d8b8560a09de284 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de28b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.174647:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1787692308.174650:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de261 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.174655:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d6400 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692308.174657:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de261 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.174663:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de261 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692308.174669:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de261 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692308.174680:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787692308.174707:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de261 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.174712:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787692308.174781:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125848064:0@lo:103: 00000100:00100000:2.0:1787692308.174858:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692308.174891:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125847936:0@lo:103: 00000100:00100000:2.0:1787692308.174912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692308.174996:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125848064 00000100:00100000:1.0:1787692308.175002:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125848064 00010000:00010000:1.0:1787692308.175041:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ecc62caa00/0x5d8b8560a09de261 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de25a expref: 19 pid: 5823 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692308.175070:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125847936 00000100:00100000:1.0:1787692308.175073:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125847936 00010000:00010000:1.0:1787692308.175095:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec80031000/0x5d8b8560a09de28b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de284 expref: 20 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692308.175109:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787692308.175116:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+20:3305:x1874531125848064:12345-0@lo:103: 00010000:00010000:1.0:1787692308.175126:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692308.175130:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ecc62caa00/0x5d8b8560a09de261 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de25a expref: 20 pid: 5823 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.175140:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ecc62caa00/0x5d8b8560a09de261 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de25a expref: 20 pid: 5823 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.175155:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecc62caa00/0x5d8b8560a09de261 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de25a expref: 20 pid: 5823 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.175175:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692308.175223:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125848064:12345-0@lo:103: Request processed in 107us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692308.175230:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787692308.175247:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787692308.175254:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+18:3305:x1874531125847936:12345-0@lo:103: 00010000:00010000:1.0:1787692308.175261:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692308.175264:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec80031000/0x5d8b8560a09de28b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de284 expref: 18 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.175272:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec80031000/0x5d8b8560a09de28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de284 expref: 18 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.175283:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec80031000/0x5d8b8560a09de28b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de284 expref: 18 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.175293:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692308.175314:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+17:3305:x1874531125847936:12345-0@lo:103: Request processed in 61us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692308.175320:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787692308.175343:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125848064:0@lo:103: 00000100:00100000:3.0:1787692308.175353:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125847936:0@lo:103: 00010000:00010000:2.0:1787692308.175693:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787692308.175795:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de261 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.175803:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de25a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de261 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.175915:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787692308.175919:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de237 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.175925:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d6800 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692308.175929:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de237 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.175937:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de237 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692308.175944:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de237 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692308.175950:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787692308.176041:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de237 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.176048:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787692308.176206:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125848192:0@lo:103: 00000100:00100000:2.0:1787692308.176246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692308.176334:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125848192 00000100:00100000:3.0:1787692308.176340:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125848192 00010000:00010000:3.0:1787692308.176361:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ecc62cb800/0x5d8b8560a09de237 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de230 expref: 17 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692308.176389:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787692308.176397:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+17:3306:x1874531125848192:12345-0@lo:103: 00010000:00010000:3.0:1787692308.176406:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692308.176410:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ecc62cb800/0x5d8b8560a09de237 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de230 expref: 17 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.176417:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de237 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692308.176419:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ecc62cb800/0x5d8b8560a09de237 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de230 expref: 17 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692308.176430:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecc62cb800/0x5d8b8560a09de237 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de230 expref: 17 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692308.176440:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692308.176480:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+16:3306:x1874531125848192:12345-0@lo:103: Request processed in 84us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692308.176496:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787692308.176521:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125848192:0@lo:103: 00010000:00010000:0.0:1787692308.176561:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec813d6800/0x5d8b8560a09de230 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de237 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.176572:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787692308.176576:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de1ff expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.176581:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d6e00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692308.176584:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de1ff expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.176591:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de1ff expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692308.176597:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de1ff expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692308.176602:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787692308.176660:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de1ff expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.176667:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787692308.176687:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de1ff expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.176693:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec813d6e00/0x5d8b8560a09de1f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de1ff expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.176702:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787692308.176711:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de1d5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.176716:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecc62cb200 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692308.176719:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de1d5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.176726:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de1d5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692308.176732:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de1d5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692308.176737:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1787692308.176796:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125848320:0@lo:103: 00010000:00010000:2.0:1787692308.176827:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787692308.176842:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692308.176869:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125848320 00000100:00100000:2.0:1787692308.176873:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125848320 00010000:00010000:2.0:1787692308.176891:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de1ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de1f8 expref: 16 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692308.176910:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787692308.176916:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+16:3307:x1874531125848320:12345-0@lo:103: 00010000:00010000:2.0:1787692308.176931:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692308.176935:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de1ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de1f8 expref: 16 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.176944:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de1ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de1f8 expref: 16 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.176954:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de1ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de1f8 expref: 16 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.176962:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692308.177007:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+15:3307:x1874531125848320:12345-0@lo:103: Request processed in 91us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692308.177023:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787692308.177222:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125848320:0@lo:103: 00010000:00010000:3.0:1787692308.177253:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692308.177255:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692308.177257:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692308.177282:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de1d5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.177288:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787692308.177313:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de1d5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.177320:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb200/0x5d8b8560a09de1ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de1d5 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692308.177330:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692308.177332:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692308.177334:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692308.177340:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787692308.177349:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125848448:0@lo:103: 00000100:00100000:0.0:1787692308.177376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787692308.177399:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de245 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.177407:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d6200 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:1.0:1787692308.177410:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de245 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.177417:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de245 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787692308.177432:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de245 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692308.177438:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787692308.177446:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de229 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.177453:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d7a00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:2.0:1787692308.177456:0:8438:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de229 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.177466:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de229 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787692308.177472:0:8438:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de229 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692308.177478:0:8438:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787692308.177511:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de245 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.177517:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787692308.177529:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de245 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.177537:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de23e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de245 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.177547:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692308.177549:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692308.177551:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692308.177557:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787692308.177582:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125848448 00000100:00100000:3.0:1787692308.177586:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125848448 00010000:00010000:3.0:1787692308.177602:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de1d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de1ce expref: 15 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692308.177639:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787692308.177645:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+15:3305:x1874531125848448:12345-0@lo:103: 00000100:00100000:1.0:1787692308.177654:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125848576:0@lo:103: 00000100:00100000:1.0:1787692308.177686:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692308.177707:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787692308.177713:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1787692308.177757:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692308.177761:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de1d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de1ce expref: 15 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692308.177773:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de1d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de1ce expref: 15 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692308.177782:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecc62cb600/0x5d8b8560a09de1d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de1ce expref: 15 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692308.177790:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692308.177831:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+14:3305:x1874531125848448:12345-0@lo:103: Request processed in 187us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692308.177837:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787692308.177853:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125848576 00000100:00100000:3.0:1787692308.177855:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125848576 00010000:00010000:3.0:1787692308.177865:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de245 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de23e expref: 14 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692308.177875:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787692308.177879:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+14:3304:x1874531125848576:12345-0@lo:103: 00010000:00010000:3.0:1787692308.177885:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692308.177888:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de245 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de23e expref: 14 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692308.177895:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de23e expref: 14 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692308.177904:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecc62cba00/0x5d8b8560a09de245 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de23e expref: 14 pid: 5826 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692308.177912:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692308.177932:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+13:3304:x1874531125848576:12345-0@lo:103: Request processed in 53us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692308.177937:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787692308.178037:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125848576:0@lo:103: 00010000:00010000:2.0:1787692308.178779:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de229 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.178799:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787692308.178922:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125848448:0@lo:103: 00010000:00010000:2.0:1787692308.179088:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de229 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.179096:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de229 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.179112:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692308.179114:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692308.179116:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692308.179216:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787692308.179236:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125848704:0@lo:103: 00000100:00100000:0.0:1787692308.179282:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692308.179422:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125848704 00000100:00100000:2.0:1787692308.179427:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125848704 00010000:00010000:2.0:1787692308.179451:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ecc62ca000/0x5d8b8560a09de229 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de222 expref: 13 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692308.179483:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787692308.179492:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+13:3307:x1874531125848704:12345-0@lo:103: 00010000:00010000:2.0:1787692308.179501:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692308.179505:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ecc62ca000/0x5d8b8560a09de229 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de222 expref: 13 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.179513:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ecc62ca000/0x5d8b8560a09de229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de222 expref: 13 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.179525:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecc62ca000/0x5d8b8560a09de229 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de222 expref: 13 pid: 5825 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.179536:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692308.179582:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+12:3307:x1874531125848704:12345-0@lo:103: Request processed in 91us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692308.179595:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787692308.179776:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125848704:0@lo:103: 00000100:00100000:2.0:1787692308.181687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692308.181730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692308.182345:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531107999872 00000100:00100000:1.0:1787692308.182352:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125846784:192.168.206.27@tcp:104: 00000100:00100000:0.0:1787692308.182361:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531107999872 00000100:00100000:1.0:1787692308.182365:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8433:1874531125846912:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692308.182399:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92eca6425000/0x5d8b8560a09de2a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2116 expref: 10 pid: 5825 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692308.182545:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108000000 00000100:00100000:0.0:1787692308.182549:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108000000 00010000:00010000:0.0:1787692308.182566:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec80030a00/0x5d8b8560a09de299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b210f expref: 11 pid: 5826 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.182617:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692308.185270:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:3.0:1787692308.185304:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0696784b-1191-4b0f-b755-3a72c69e021b+11:2362:x1874531107999872:12345-192.168.206.27@tcp:103: 00010000:00010000:3.0:1787692308.185329:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787692308.185387:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:2.0:1787692308.185412:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0696784b-1191-4b0f-b755-3a72c69e021b+11:2361:x1874531108000000:12345-192.168.206.27@tcp:103: 00010000:00010000:3.0:1787692308.185471:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92eca6425000/0x5d8b8560a09de2a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2116 expref: 11 pid: 5825 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692308.185495:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92eca6425000/0x5d8b8560a09de2a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2116 expref: 11 pid: 5825 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692308.185542:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6425000/0x5d8b8560a09de2a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2116 expref: 11 pid: 5825 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692308.185565:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692308.185739:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531107999872:12345-192.168.206.27@tcp:103: Request processed in 452us (4059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692308.185749:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00010000:00010000:2.0:1787692308.186327:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692308.186342:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec80030a00/0x5d8b8560a09de299 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b210f expref: 9 pid: 5826 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.186358:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec80030a00/0x5d8b8560a09de299 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b210f expref: 9 pid: 5826 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.186375:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec80030a00/0x5d8b8560a09de299 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b210f expref: 9 pid: 5826 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.186392:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.186401:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.186417:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.186435:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.186442:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.186466:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.186472:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692308.186477:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.186485:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.186507:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692308.186519:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692308.186582:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0696784b-1191-4b0f-b755-3a72c69e021b+8:2361:x1874531108000000:12345-192.168.206.27@tcp:103: Request processed in 1181us (4850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692308.186591:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00010000:00010000:1.0:1787692308.187220:0:8433:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.187230:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692308.187235:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de2d8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692308.289315:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125848832:0@lo:400: 00000100:00100000:1.0:1787692308.289391:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692308.289446:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125849344:0@lo:400: 00000100:00100000:1.0:1787692308.289472:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692308.289505:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787692308.289511:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874531125849216:0@lo:400: 00000100:00100000:1.0:1787692308.289532:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692308.289558:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125848960:0@lo:400: 00000100:00100000:1.0:1787692308.289591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692308.289611:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787692308.289616:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125849088:0@lo:400: 00000100:00100000:1.0:1787692308.289644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692308.289674:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125849344 00000100:00100000:1.0:1787692308.289681:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125849344 00000100:00100000:1.0:1787692308.289727:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125849088 00000100:00100000:1.0:1787692308.289729:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125849088 00000100:00100000:1.0:1787692308.289749:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787692308.289757:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125849344:12345-0@lo:400: 00000100:00100000:1.0:1787692308.289835:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125849344:12345-0@lo:400: Request processed in 55us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692308.289843:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787692308.289858:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787692308.289864:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125849088:12345-0@lo:400: 00000100:00100000:1.0:1787692308.289893:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125849088:12345-0@lo:400: Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692308.289899:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787692308.289916:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125848832 00000100:00100000:1.0:1787692308.289919:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125848832 00000100:00100000:1.0:1787692308.289940:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125849216 00000100:00100000:1.0:1787692308.289942:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125849216 00000100:00100000:1.0:1787692308.289953:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125848960 00000100:00100000:1.0:1787692308.289955:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125848960 00000100:00100000:1.0:1787692308.289966:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787692308.289972:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125848832:12345-0@lo:400: 00000100:00100000:3.0:1787692308.290452:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787692308.290463:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874531125849216:12345-0@lo:400: 00000100:00100000:3.0:1787692308.290505:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874531125849216:12345-0@lo:400: Request processed in 46us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692308.290511:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787692308.290525:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787692308.290532:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125848960:12345-0@lo:400: 00000100:00100000:3.0:1787692308.290560:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125848960:12345-0@lo:400: Request processed in 30us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692308.290566:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787692308.290686:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125848832:12345-0@lo:400: Request processed in 712us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692308.290692:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787692308.290719:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787692308.290725:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787692308.290728:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787692308.290768:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec878b0000 x1874531125849088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692308.290782:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125849088:0@lo:400: 00000100:00100000:1.0:1787692308.290793:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125848960:0@lo:400: 00000100:00100000:1.0:1787692308.290975:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874531125849216:0@lo:400: 00000100:00100000:1.0:1787692308.291001:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125848832:0@lo:400: 00010000:00080000:1.0:1787692308.291021:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec878b0e00 x1874531125849344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692308.291031:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125849344:0@lo:400: 00000100:00100000:1.0:1787692308.801236:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125849472:0@lo:13: 00000100:00100000:1.0:1787692308.801325:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692308.801684:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125849472 00000100:00100000:3.0:1787692308.801696:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125849472 00000100:00100000:3.0:1787692308.801858:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787692308.801871:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125849472:12345-0@lo:13: 00002000:00000024:3.0:1787692308.801914:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692308.801970:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125849472:12345-0@lo:13: Request processed in 102us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692308.801977:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787692308.802467:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf6e3100 x1874531125849472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692308.802493:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125849472:0@lo:13: 00010000:00010000:3.0:1787692308.993108:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692309.153181:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692309.153225:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692309.153265:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692309.153292:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692309.153521:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108000512 00000100:00100000:1.0:1787692309.153530:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108000512 00000100:00100000:1.0:1787692309.153616:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108000384 00000100:00100000:1.0:1787692309.153620:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108000384 00000100:00100000:1.0:1787692309.153648:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:1.0:1787692309.153658:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108000512:12345-192.168.206.27@tcp:400: 00000100:00100000:1.0:1787692309.153736:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108000512:12345-192.168.206.27@tcp:400: Request processed in 79us (510us total) trans 0 rc 0/0 00000100:00080000:2.0:1787692309.153828:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787692309.153832:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787692309.153862:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:2.0:1787692309.153871:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108000384:12345-192.168.206.27@tcp:400: 00000100:00100000:2.0:1787692309.153898:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108000384:12345-192.168.206.27@tcp:400: Request processed in 29us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692309.153904:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:2.0:1787692309.153944:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108000128 00000100:00100000:2.0:1787692309.153947:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108000128 00000100:00100000:2.0:1787692309.153971:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 129 00000100:00100000:2.0:1787692309.153978:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+8:2361:x1874531108000128:12345-192.168.206.27@tcp:400: 00000100:00100000:2.0:1787692309.154004:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+8:2361:x1874531108000128:12345-192.168.206.27@tcp:400: Request processed in 27us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692309.154021:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 129 00000100:00100000:1.0:1787692309.154381:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:3.0:1787692309.154459:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108000256 00000100:00100000:3.0:1787692309.154463:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108000256 00000100:00100000:3.0:1787692309.154635:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:3.0:1787692309.154644:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108000256:12345-192.168.206.27@tcp:400: 00000100:00100000:3.0:1787692309.154707:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108000256:12345-192.168.206.27@tcp:400: Request processed in 64us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.154714:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00080000:2.0:1787692309.156916:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1787692309.634370:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787692309.634390:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92eb85134000 from 39 10000000:01000000:0.0:1787692309.634395:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787692309.634449:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692309.634460:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692309.634470:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692309.634492:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125849600:0@lo:101: 00000100:00100000:0.0:1787692309.634569:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692309.634644:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec832ff840 going to sleep for 11 seconds 00000100:00100000:2.0:1787692309.634962:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125849600 00000100:00100000:2.0:1787692309.634970:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125849600 00000100:00100000:2.0:1787692309.635033:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787692309.635043:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+12:5828:x1874531125849600:12345-0@lo:101: 00010000:00010000:2.0:1787692309.635057:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692309.635071:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de2e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de2df expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692309.635093:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de2df expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692309.635103:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de2df expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692309.635111:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2600, rc 0) 00000100:00100000:2.0:1787692309.635158:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+13:5828:x1874531125849600:12345-0@lo:101: Request processed in 117us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692309.635164:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1787692309.636136:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125849600:0@lo:101: 00010000:00010000:0.0:1787692309.636160:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692309.636196:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692309.636472:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125849728:0@lo:501: 00000100:00100000:0.0:1787692309.636520:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692309.636564:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec832ff840 going to sleep for 11 seconds 00000100:00100000:2.0:1787692309.637513:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125849728 00000100:00100000:2.0:1787692309.637524:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125849728 00000100:00100000:2.0:1787692309.637583:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787692309.637606:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:5828:x1874531125849728:12345-0@lo:501: 00000100:00100000:2.0:1787692309.637950:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:5828:x1874531125849728:12345-0@lo:501: Request processed in 346us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692309.637959:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787692309.638954:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125849728:0@lo:501: 00000100:00100000:0.0:1787692309.639015:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125849856:0@lo:503: 00000100:00100000:0.0:1787692309.639077:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692309.639118:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec832ff840 going to sleep for 11 seconds 00000100:00100000:1.0:1787692309.639197:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125849856 00000100:00100000:1.0:1787692309.639204:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125849856 00000100:00100000:1.0:1787692309.639260:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787692309.639268:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:5828:x1874531125849856:12345-0@lo:503: 00000100:00100000:1.0:1787692309.639459:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:5828:x1874531125849856:12345-0@lo:503: Request processed in 191us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692309.639467:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787692309.639791:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125849856:0@lo:503: 00000100:00100000:0.0:1787692309.641114:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8453:1874531125849984:0@lo:502: 00000100:00100000:0.0:1787692309.641200:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692309.641237:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec832ff780 going to sleep for 11 seconds 00000100:00100000:1.0:1787692309.641700:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125849984 00000100:00100000:1.0:1787692309.641708:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125849984 00000100:00100000:1.0:1787692309.641756:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787692309.641764:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+13:8453:x1874531125849984:12345-0@lo:502: 00000100:00100000:1.0:1787692309.642075:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+13:8453:x1874531125849984:12345-0@lo:502: Request processed in 310us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692309.642082:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787692309.642512:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8453:1874531125849984:0@lo:502: 00000100:00100000:0.0:1787692309.642569:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8453:1874531125850112:0@lo:502: 00000100:00100000:0.0:1787692309.642614:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692309.642649:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec832ff780 going to sleep for 11 seconds 00000100:00100000:2.0:1787692309.642926:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125850112 00000100:00100000:2.0:1787692309.642932:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125850112 00000100:00100000:2.0:1787692309.642974:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787692309.642983:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:8453:x1874531125850112:12345-0@lo:502: 00000100:00100000:2.0:1787692309.644786:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+13:8453:x1874531125850112:12345-0@lo:502: Request processed in 1795us (2162us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692309.644800:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787692309.645158:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8453:1874531125850112:0@lo:502: 00000040:00080000:0.0:1787692309.645205:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787692309.645671:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787692309.645692:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787692309.645702:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692309.645712:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692309.645723:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1787692309.645726:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1787692309.645728:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787692309.645760:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692309.645768:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692309.645778:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692309.645797:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125850240:0@lo:101: 00000100:00100000:1.0:1787692309.650367:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692309.651657:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787692309.658660:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125850240 00000100:00100000:2.0:1787692309.658676:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125850240 00000100:00100000:2.0:1787692309.658745:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787692309.658765:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+13:5828:x1874531125850240:12345-0@lo:101: 00010000:00010000:2.0:1787692309.658782:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692309.658800:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09de2f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de2ed expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692309.658848:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09de2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de2ed expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692309.658859:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09de2f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de2ed expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692309.658868:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2e00, rc 0) 00000100:00100000:2.0:1787692309.658960:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125850240:12345-0@lo:101: Request processed in 198us (8600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692309.658983:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787692309.659134:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125850240:0@lo:101: 00010000:00010000:3.0:1787692309.659154:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.659164:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692309.659231:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125850368:0@lo:501: 00000100:00100000:3.0:1787692309.659265:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692309.659301:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787692309.659392:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125850368 00000100:00100000:0.0:1787692309.659397:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125850368 00000100:00100000:0.0:1787692309.659430:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787692309.659438:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125850368:12345-0@lo:501: 00000100:00100000:0.0:1787692309.659684:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125850368:12345-0@lo:501: Request processed in 247us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692309.659691:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787692309.659863:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125850368:0@lo:501: 00000100:00100000:3.0:1787692309.659892:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125850496:0@lo:503: 00000100:00100000:3.0:1787692309.659931:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692309.659948:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6240 going to sleep for 11 seconds 00000100:00100000:2.0:1787692309.660545:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125850496 00000100:00100000:2.0:1787692309.660551:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125850496 00000100:00100000:2.0:1787692309.660583:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787692309.660592:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125850496:12345-0@lo:503: 00000100:00100000:2.0:1787692309.660783:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125850496:12345-0@lo:503: Request processed in 191us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692309.660791:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787692309.661328:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125850496:0@lo:503: 00000100:00100000:3.0:1787692309.662668:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8454:1874531125850624:0@lo:502: 00000100:00100000:3.0:1787692309.662745:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692309.662798:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787692309.664037:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125850624 00000100:00100000:2.0:1787692309.664049:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125850624 00000100:00100000:2.0:1787692309.664115:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787692309.664126:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+14:8454:x1874531125850624:12345-0@lo:502: 00000100:00100000:2.0:1787692309.664620:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+14:8454:x1874531125850624:12345-0@lo:502: Request processed in 494us (1873us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692309.664629:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787692309.668265:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8454:1874531125850624:0@lo:502: 00000020:01000000:3.0:1787692309.668315:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787692309.668328:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692309.668331:0:8454:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787692309.668338:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787692309.668451:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8454:1874531125850752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692309.668534:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692309.668638:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787692309.672463:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125850752 00000100:00100000:2.0:1787692309.672478:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125850752 00000100:00100000:3.0:1787692309.674159:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787692309.674184:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:8454:x1874531125850752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692309.674592:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+14:8454:x1874531125850752:12345-0@lo:502:llog_process_th.0 Request processed in 420us (6057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.674601:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787692309.674703:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8454:1874531125850752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787692309.674738:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787692309.674748:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787692309.674751:0:8454:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787692309.674756:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787692309.675327:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787692309.675349:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787692309.675359:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692309.675371:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692309.675393:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787692309.675396:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ecafbbe800 from 39 10000000:01000000:1.0:1787692309.675399:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787692309.675428:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692309.675437:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692309.675446:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692309.675467:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125850880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787692309.675513:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692309.682534:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07840 going to sleep for 11 seconds 00000100:00100000:0.0:1787692309.686614:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125850880 00000100:00100000:0.0:1787692309.686631:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125850880 00000100:00100000:0.0:1787692309.686706:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787692309.686717:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+14:5828:x1874531125850880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692309.686733:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692309.686751:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6424a00/0x5d8b8560a09de302 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de2fb expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692309.686777:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6424a00/0x5d8b8560a09de302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de2fb expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692309.686787:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6424a00/0x5d8b8560a09de302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de2fb expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692309.686796:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6424a00, rc 0) 00000100:00100000:0.0:1787692309.688419:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125850880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1695us (12895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692309.688431:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787692309.690711:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125850880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787692309.690743:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692309.690757:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692309.691110:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125851008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692309.691172:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692309.691222:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07840 going to sleep for 11 seconds 00000100:00100000:3.0:1787692309.691464:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125851008 00000100:00100000:3.0:1787692309.691471:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125851008 00000100:00100000:3.0:1787692309.691517:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787692309.691525:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125851008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787692309.691777:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125851008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 252us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.691785:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787692309.692264:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125851008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692309.692302:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125851136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692309.692346:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692309.692420:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07840 going to sleep for 11 seconds 00000100:00100000:0.0:1787692309.696727:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125851136 00000100:00100000:0.0:1787692309.696743:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125851136 00000100:00100000:0.0:1787692309.697335:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787692309.697353:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125851136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692309.702732:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125851136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5377us (10375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692309.702747:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787692309.713567:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b42d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125851136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787692309.715625:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8455:1874531125851264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787692309.715713:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692309.715758:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692309.715861:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125851264 00000100:00100000:0.0:1787692309.715874:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125851264 00000100:00100000:0.0:1787692309.715926:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787692309.715936:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+15:8455:x1874531125851264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787692309.716485:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+15:8455:x1874531125851264:12345-0@lo:502:llog_process_th.0 Request processed in 548us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692309.716494:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787692309.718526:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8455:1874531125851264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692309.718730:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8455:1874531125851392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692309.718800:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692309.719192:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6240 going to sleep for 11 seconds 00000100:00100000:1.0:1787692309.719489:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125851392 00000100:00100000:1.0:1787692309.719497:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125851392 00000100:00100000:3.0:1787692309.719615:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787692309.719623:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+15:8455:x1874531125851392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692309.720402:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+15:8455:x1874531125851392:12345-0@lo:502:llog_process_th.0 Request processed in 775us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.720412:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1787692309.720697:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8455:1874531125851392:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787692309.720926:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787692309.721165:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787692309.721247:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787692309.721257:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692309.721269:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692309.721279:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787692309.721282:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1787692309.721284:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787692309.721320:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692309.721328:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692309.721336:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692309.721357:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125851520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787692309.721472:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692309.721558:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec83c129c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692309.721598:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125851520 00000100:00100000:3.0:1787692309.721604:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125851520 00000100:00100000:3.0:1787692309.721678:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787692309.721687:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+15:5828:x1874531125851520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787692309.721699:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692309.721711:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec8b35ac00/0x5d8b8560a09de310 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de309 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.721733:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec8b35ac00/0x5d8b8560a09de310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de309 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.721742:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec8b35ac00/0x5d8b8560a09de310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de309 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.721750:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35ac00, rc 0) 00000100:00100000:3.0:1787692309.721851:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125851520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.721858:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787692309.722055:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125851520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692309.722067:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692309.722076:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692309.722272:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125851648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692309.722302:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692309.722332:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07600 going to sleep for 11 seconds 00000100:00100000:2.0:1787692309.722442:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125851648 00000100:00100000:2.0:1787692309.722448:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125851648 00000100:00100000:2.0:1787692309.722484:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787692309.722492:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125851648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692309.722742:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125851648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692309.722749:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787692309.723038:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125851648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692309.723068:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125851776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692309.723107:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692309.723134:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07600 going to sleep for 11 seconds 00000100:00100000:2.0:1787692309.723244:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125851776 00000100:00100000:2.0:1787692309.723249:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125851776 00000100:00100000:2.0:1787692309.723315:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787692309.723323:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125851776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787692309.723476:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125851776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692309.723483:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787692309.723666:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125851776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787692309.724152:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8456:1874531125851904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692309.724200:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692309.724226:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6240 going to sleep for 11 seconds 00000100:00100000:2.0:1787692309.724331:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125851904 00000100:00100000:2.0:1787692309.724336:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125851904 00000100:00100000:2.0:1787692309.724366:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787692309.724474:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:8456:x1874531125851904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692309.724677:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:8456:x1874531125851904:12345-0@lo:502:llog_process_th.0 Request processed in 304us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.724685:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787692309.724783:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8456:1874531125851904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787692309.724807:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787692309.724844:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787692309.724847:0:8456:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787692309.724852:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787692309.724874:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8456:1874531125852032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787692309.724907:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692309.724926:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1787692309.724989:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125852032 00000100:00100000:3.0:1787692309.724993:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125852032 00000100:00100000:3.0:1787692309.725032:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787692309.725039:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+16:8456:x1874531125852032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692309.725151:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+16:8456:x1874531125852032:12345-0@lo:502:llog_process_th.0 Request processed in 112us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.725157:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787692309.725331:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8456:1874531125852032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787692309.725349:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787692309.725354:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787692309.725356:0:8456:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787692309.725359:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787692309.725619:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787692309.725636:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787692309.725644:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.725655:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692309.725665:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787692309.725668:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ec9dbcc000 from 39 10000000:01000000:3.0:1787692309.725670:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787692309.725693:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.725701:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.725708:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692309.725723:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125852160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787692309.725752:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692309.725782:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90137000 going to sleep for 11 seconds 00000100:00100000:2.0:1787692309.727299:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125852160 00000100:00100000:2.0:1787692309.727311:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125852160 00000100:00100000:2.0:1787692309.727358:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787692309.727368:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125852160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787692309.727459:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692309.727475:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec814a2c00/0x5d8b8560a09de31e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de317 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692309.727498:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a2c00/0x5d8b8560a09de31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de317 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692309.727510:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec814a2c00/0x5d8b8560a09de31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de317 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692309.727519:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2c00, rc 0) 00000100:00100000:2.0:1787692309.727579:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125852160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 212us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692309.727586:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787692309.727870:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125852160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787692309.727885:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.727894:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692309.727950:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125852288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787692309.728116:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692309.728146:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90137000 going to sleep for 11 seconds 00000100:00100000:2.0:1787692309.728284:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125852288 00000100:00100000:2.0:1787692309.728289:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125852288 00000100:00100000:2.0:1787692309.728311:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787692309.728317:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125852288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692309.730322:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125852288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1995us (2197us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692309.730348:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787692309.730595:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125852288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692309.730646:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125852416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692309.730707:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692309.730732:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07600 going to sleep for 11 seconds 00000100:00100000:3.0:1787692309.730841:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125852416 00000100:00100000:3.0:1787692309.730848:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125852416 00000100:00100000:3.0:1787692309.730879:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787692309.730886:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125852416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787692309.731072:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125852416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 185us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.731079:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787692309.731560:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125852416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787692309.732747:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8457:1874531125852544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787692309.732885:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692309.732924:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692309.733287:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125852544 00000100:00100000:3.0:1787692309.733294:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125852544 00000100:00100000:3.0:1787692309.733344:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787692309.733353:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:8457:x1874531125852544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692309.733686:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:8457:x1874531125852544:12345-0@lo:502:llog_process_th.0 Request processed in 333us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.733694:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787692309.734302:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8457:1874531125852544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787692309.734360:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8457:1874531125852672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787692309.734484:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692309.734567:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692309.742479:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125852672 00000100:00100000:0.0:1787692309.742493:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125852672 00000100:00100000:1.0:1787692309.743877:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787692309.743890:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+17:8457:x1874531125852672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692309.744183:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+17:8457:x1874531125852672:12345-0@lo:502:llog_process_th.0 Request processed in 295us (9697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692309.744191:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787692309.744298:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8457:1874531125852672:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787692309.744331:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787692309.744444:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787692309.744461:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787692309.744470:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692309.744481:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692309.744491:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787692309.744493:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787692309.744496:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787692309.744522:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692309.744529:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692309.744538:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692309.744567:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125852800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787692309.744605:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692309.746687:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c070c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692309.753340:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125852800 00000100:00100000:2.0:1787692309.753356:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125852800 00000100:00100000:3.0:1787692309.753498:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787692309.753510:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125852800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787692309.753538:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692309.753556:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09de32c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de325 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.753584:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09de32c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de325 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.753595:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09de32c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de325 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.753604:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35be00, rc 0) 00000100:00100000:3.0:1787692309.753701:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125852800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (9094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.753708:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787692309.753938:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b42680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125852800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787692309.753957:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692309.753968:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692309.754135:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125852928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692309.754172:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692309.754284:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692309.754359:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125852928 00000100:00100000:3.0:1787692309.754364:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125852928 00000100:00100000:3.0:1787692309.754397:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787692309.754404:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125852928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787692309.754637:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125852928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.754644:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1787692309.755319:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125852928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692309.755360:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125853056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787692309.755421:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692309.756138:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692309.763847:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125853056 00000100:00100000:1.0:1787692309.763863:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125853056 00000100:00100000:3.0:1787692309.764037:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787692309.764049:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125853056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787692309.764301:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125853056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (8879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.764309:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787692309.764413:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125853056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787692309.764939:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8458:1874531125853184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787692309.765018:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692309.765058:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec83c12900 going to sleep for 11 seconds 00000100:00100000:3.0:1787692309.765191:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125853184 00000100:00100000:3.0:1787692309.765203:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125853184 00000100:00100000:3.0:1787692309.765248:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787692309.765256:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:8458:x1874531125853184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692309.765438:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:8458:x1874531125853184:12345-0@lo:502:llog_process_th.0 Request processed in 183us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.765445:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787692309.765553:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8458:1874531125853184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787692309.765579:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787692309.765589:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692309.765591:0:8458:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787692309.765598:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787692309.765618:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8458:1874531125853312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787692309.765652:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692309.765665:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec83c12900 going to sleep for 11 seconds 00000100:00100000:3.0:1787692309.765781:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125853312 00000100:00100000:3.0:1787692309.765785:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125853312 00000100:00100000:3.0:1787692309.765837:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787692309.765845:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:8458:x1874531125853312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692309.765986:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:8458:x1874531125853312:12345-0@lo:502:llog_process_th.0 Request processed in 130us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692309.765994:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787692309.766139:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8458:1874531125853312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787692309.766158:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787692309.766163:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692309.766165:0:8458:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787692309.766169:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787692309.769728:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1787692309.769770:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787692309.769782:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.769794:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692309.769805:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787692309.769808:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92ec87fd3370 from 1 10000000:01000000:3.0:1787692309.769845:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787692309.769883:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b000/0x5d8b8560a09de333 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.769892:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b000/0x5d8b8560a09de333 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692309.769918:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b000/0x5d8b8560a09de333 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692309.769944:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125853440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787692309.770026:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692309.770072:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecaf9690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692309.770142:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125853440 00000100:00100000:0.0:1787692309.770149:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125853440 00000100:00100000:0.0:1787692309.770209:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787692309.770221:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125853440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692309.770234:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692309.770246:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6424400/0x5d8b8560a09de33a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de333 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692309.770270:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6424400/0x5d8b8560a09de33a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de333 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692309.770280:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6424400/0x5d8b8560a09de33a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de333 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692309.770289:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6424400, rc 0) 00000100:00100000:0.0:1787692309.770336:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125853440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692309.770344:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787692309.770443:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125853440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787692309.770456:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b000/0x5d8b8560a09de333 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de33a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692309.770464:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b000/0x5d8b8560a09de333 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de33a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692309.770512:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125853568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692309.770539:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692309.770568:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07240 going to sleep for 11 seconds 00000100:00100000:0.0:1787692309.770781:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125853568 00000100:00100000:0.0:1787692309.770786:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125853568 00000100:00100000:0.0:1787692309.770844:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787692309.770854:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125853568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787692309.771089:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125853568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (548us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787692309.771098:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787692309.771194:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125853568:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787692309.771219:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787692309.771225:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b000/0x5d8b8560a09de333 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de33a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692309.771233:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b000/0x5d8b8560a09de333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de33a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692309.825219:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125853696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787692309.825284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692309.825421:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125853696 00000100:00100000:0.0:1787692309.825429:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125853696 00000100:00100000:0.0:1787692309.825482:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787692309.825492:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125853696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787692309.825530:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692309.825584:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125853696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692309.825591:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1787692309.825705:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaed7e300 x1874531125853696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692309.825723:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125853696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787692310.016956:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692311.043009:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692312.066011:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692313.089405:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692313.409268:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787692313.411553:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125853952:0@lo:400:kworker.0 00000100:00100000:1.0:1787692313.411636:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692313.411719:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125853824:0@lo:400:kworker.0 00000100:00100000:0.0:1787692313.412242:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125854080:0@lo:400:kworker.0 00000100:00100000:3.0:1787692313.412267:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125854208:0@lo:400:kworker.0 00000100:00100000:0.0:1787692313.412335:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692313.412344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692313.412467:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125853952 00000100:00100000:2.0:1787692313.412478:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125853952 00000100:00100000:0.0:1787692313.412485:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125854080 00000100:00100000:0.0:1787692313.412494:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125854080 00000100:00100000:2.0:1787692313.412546:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787692313.412671:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125854208 00000100:00100000:3.0:1787692313.412676:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125854208 00000100:00100000:0.0:1787692313.412755:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787692313.412769:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787692313.412780:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125854208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692313.412799:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692313.412854:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125854464:0@lo:400:kworker.0 00000100:00100000:1.0:1787692313.412899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692313.412921:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787692313.412928:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874531125854336:0@lo:400:kworker.0 00000100:00100000:1.0:1787692313.412951:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692313.412994:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125854464 00000100:00100000:1.0:1787692313.412999:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125854464 00000100:00100000:1.0:1787692313.413026:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787692313.413033:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125854464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692313.413068:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125854464:12345-0@lo:400:kworker.0 Request processed in 36us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692313.413075:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787692313.413116:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec878b0000 x1874531125854464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692313.413129:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125854464:0@lo:400:kworker.0 00000100:00080000:1.0:1787692313.413167:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787692313.413184:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787692313.413186:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692313.413445:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125854208:12345-0@lo:400:kworker.0 Request processed in 666us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692313.413453:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787692313.413473:0:5833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1787692313.413480:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00010000:00080000:3.0:1787692313.414247:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec878b0380 x1874531125854208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692329 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692313.414260:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125854208:0@lo:400:kworker.0 00000100:00100000:3.0:1787692313.414298:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125854336 00000100:00100000:3.0:1787692313.414302:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125854336 00000100:00100000:2.0:1787692313.417569:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125853952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692313.417702:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125853952:12345-0@lo:400:kworker.0 Request processed in 5140us (6060us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692313.417706:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125854080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692313.417718:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787692313.417846:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125854080:12345-0@lo:400:kworker.0 Request processed in 5080us (5511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692313.417857:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787692313.417941:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125853952:0@lo:400:kworker.0 00000100:00100000:0.0:1787692313.418014:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125854080:0@lo:400:kworker.0 00000100:00100000:0.0:1787692313.418064:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125853824 00000100:00100000:0.0:1787692313.418072:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125853824 00000100:00100000:0.0:1787692313.418138:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787692313.418152:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3307:x1874531125853824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692313.418206:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3307:x1874531125853824:12345-0@lo:400:kworker.0 Request processed in 58us (5408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692313.418212:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787692313.418306:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125853824:0@lo:400:kworker.0 00000100:00100000:3.0:1787692313.418899:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787692313.418911:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874531125854336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692313.419002:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874531125854336:12345-0@lo:400:kworker.0 Request processed in 93us (6048us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692313.419017:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787692313.419085:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692313.419221:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874531125854336:0@lo:400:kworker.0 00000100:00100000:2.0:1787692313.923252:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125854592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787692313.923327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692313.923452:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125854592 00000100:00100000:3.0:1787692313.923459:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125854592 00000100:00100000:3.0:1787692313.923520:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787692313.923530:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125854592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787692313.923577:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692313.926405:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125854592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2868us (3068us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692313.926419:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787692313.926708:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf6e1500 x1874531125854592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692313.926732:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125854592:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787692314.113001:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692314.277975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692314.278034:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692314.278066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692314.278152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692314.278266:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108000896 00000100:00100000:1.0:1787692314.278275:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108000896 00000100:00100000:1.0:1787692314.278335:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108001024 00000100:00100000:1.0:1787692314.278338:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108001024 00000100:00100000:1.0:1787692314.278357:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:1.0:1787692314.278366:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531108000896:12345-192.168.206.27@tcp:400: 00000100:00100000:1.0:1787692314.278445:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531108000896:12345-192.168.206.27@tcp:400: Request processed in 79us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692314.278453:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:1.0:1787692314.278470:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:1.0:1787692314.278476:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108001024:12345-192.168.206.27@tcp:400: 00000100:00100000:1.0:1787692314.278519:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108001024:12345-192.168.206.27@tcp:400: Request processed in 43us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692314.278526:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:0.0:1787692314.278894:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108000768 00000100:00100000:0.0:1787692314.278899:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108000768 00000100:00100000:0.0:1787692314.278945:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:0.0:1787692314.278971:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108000768:12345-192.168.206.27@tcp:400: 00000100:00100000:0.0:1787692314.279013:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108000768:12345-192.168.206.27@tcp:400: Request processed in 50us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692314.279020:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00080000:2.0:1787692314.279241:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787692314.279246:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787692314.279248:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787692314.280918:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108000640 00000100:00100000:3.0:1787692314.280930:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108000640 00000100:00100000:3.0:1787692314.281009:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 163 00000100:00100000:3.0:1787692314.281020:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+8:5602:x1874531108000640:12345-192.168.206.27@tcp:101: 00010000:00010000:3.0:1787692314.281034:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692314.281052:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec8b35a000/0x5d8b8560a09de341 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2178 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692314.281079:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec8b35a000/0x5d8b8560a09de341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2178 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692314.281091:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec8b35a000/0x5d8b8560a09de341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2178 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692314.281101:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35a000, rc 0) 00000100:00100000:3.0:1787692314.281288:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+9:5602:x1874531108000640:12345-192.168.206.27@tcp:101: Request processed in 269us (3322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692314.281295:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 163 00000100:00100000:3.0:1787692314.299584:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692314.299860:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108001152 00000100:00100000:0.0:1787692314.299870:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108001152 00000100:00100000:0.0:1787692314.299938:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 164 00000100:00100000:0.0:1787692314.299959:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+9:5602:x1874531108001152:12345-192.168.206.27@tcp:501: 00000100:00100000:0.0:1787692314.300274:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+9:5602:x1874531108001152:12345-192.168.206.27@tcp:501: Request processed in 326us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692314.300283:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 164 00000100:00100000:0.0:1787692314.302916:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692314.303047:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108001280 00000100:00100000:3.0:1787692314.303057:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108001280 00000100:00100000:3.0:1787692314.303108:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 165 00000100:00100000:3.0:1787692314.303117:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+9:5602:x1874531108001280:12345-192.168.206.27@tcp:503: 00000100:00100000:3.0:1787692314.303338:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+9:5602:x1874531108001280:12345-192.168.206.27@tcp:503: Request processed in 221us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692314.303346:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 165 00000100:00100000:3.0:1787692314.309445:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692314.309884:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108001408 00000100:00100000:1.0:1787692314.309894:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108001408 00000100:00100000:1.0:1787692314.309956:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 166 00000100:00100000:1.0:1787692314.309967:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+9:6100:x1874531108001408:12345-192.168.206.27@tcp:502: 00000100:00100000:1.0:1787692314.310261:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+9:6100:x1874531108001408:12345-192.168.206.27@tcp:502: Request processed in 295us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692314.310270:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 166 00000100:00100000:2.0:1787692314.314078:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692314.314371:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108001536 00000100:00100000:1.0:1787692314.314380:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108001536 00000100:00100000:1.0:1787692314.314442:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 167 00000100:00100000:1.0:1787692314.314452:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+9:6100:x1874531108001536:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787692314.314756:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+9:6100:x1874531108001536:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 304us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692314.314764:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 167 00000100:00100000:0.0:1787692314.318969:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692314.319061:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108001664 00000100:00100000:3.0:1787692314.319071:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108001664 00000100:00100000:3.0:1787692314.319116:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 168 00000100:00100000:3.0:1787692314.319125:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+9:5602:x1874531108001664:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787692314.319139:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692314.319155:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec8b35b400/0x5d8b8560a09de348 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b217f expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692314.319182:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec8b35b400/0x5d8b8560a09de348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b217f expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692314.319193:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec8b35b400/0x5d8b8560a09de348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b217f expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692314.319202:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35b400, rc 0) 00000100:00100000:3.0:1787692314.319262:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+10:5602:x1874531108001664:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 137us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692314.319269:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 168 00000100:00100000:3.0:1787692314.324011:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692314.324132:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108001792 00000100:00100000:0.0:1787692314.324141:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108001792 00000100:00100000:0.0:1787692314.324195:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 169 00000100:00100000:0.0:1787692314.324204:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+10:5602:x1874531108001792:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787692314.324456:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+10:5602:x1874531108001792:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 252us (456us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787692314.324465:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 169 00000100:00100000:2.0:1787692314.946248:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787692314.946271:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125854720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787692314.946349:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692314.946514:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125854720 00000100:00100000:3.0:1787692314.946523:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125854720 00000100:00100000:3.0:1787692314.946575:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787692314.946585:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125854720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787692314.946621:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692314.946680:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125854720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692314.946688:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1787692314.946734:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaed7c000 x1874531125854720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692314.946754:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125854720:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787692315.137196:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787692315.599625:0:8499:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbf238720 20000000:00000080:1.0:1787692315.599641:0:8499:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92eb8520f000 uarg=0000000000000000 20000000:01000000:1.0:1787692315.599677:0:8499:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787692315.599682:0:8499:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787692315.599686:0:8499:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787692315.601733:0:8500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787692315.603121:0:8499:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1787692315.611580:0:8499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1787692315.611639:0:8499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1787692315.611702:0:8499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1787692315.611725:0:8499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787692315.611744:0:8499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692315.611774:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec80031600/0x5d8b8560a09de0c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de0bd expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692315.611782:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de126 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de11f expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692315.611788:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ecc62ca200/0x5d8b8560a09de1f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de1ea expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692315.611798:0:8499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de2ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2147 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692315.611805:0:8499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692315.611867:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de2ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2147 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692315.611882:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de2ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2147 expref: 9 pid: 5825 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692315.611903:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1874531125854848:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692315.612022:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ecc62ca200/0x5d8b8560a09de1f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de1ea expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692315.612031:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ecc62ca200/0x5d8b8560a09de1f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de1ea expref: 18 pid: 5823 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692315.612040:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1874531125854976:0@lo:104: 00000100:00100000:0.0:1787692315.612090:0:8499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692315.612126:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125854976 00010000:00010000:0.0:1787692315.612132:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de11f expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692315.612135:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125854976 00010000:00010000:0.0:1787692315.612147:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de126 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de11f expref: 18 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692315.612155:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1874531125855104:0@lo:104: 00000100:00100000:0.0:1787692315.612187:0:8499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692315.612228:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1787692315.612231:0:8499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec80031600/0x5d8b8560a09de0c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de0bd expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692315.612241:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125855104 00010000:00010000:0.0:1787692315.612242:0:8499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ec80031600/0x5d8b8560a09de0c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de0bd expref: 18 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692315.612247:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125855104 00000100:00100000:0.0:1787692315.612256:0:8499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1874531125855232:0@lo:104: 00000100:00100000:1.0:1787692315.612267:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787692315.612277:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+4:8499:x1874531125854976:12345-0@lo:104: 00000100:00100000:0.0:1787692315.612285:0:8499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787692315.612292:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de1f1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692315.612299:0:8499:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec83c12300 going to sleep for 11 seconds 00010000:00010000:1.0:1787692315.612353:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787692315.612367:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1874531125854976:0@lo:104: 00000100:00100000:1.0:1787692315.612368:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+4:8499:x1874531125854976:12345-0@lo:104: Request processed in 90us (278us total) trans 0 rc 0/0 00010000:00010000:2.0:1787692315.612378:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1787692315.612383:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1787692315.612389:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de1f1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692315.612401:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecc62cb400 already unused, calling callback (ffffffffc1b51c20) 00000100:00100000:1.0:1787692315.612403:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125855232 10000000:00010000:2.0:1787692315.612406:0:8438:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de1f1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692315.612409:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125855232 00010000:00010000:2.0:1787692315.612419:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de1f1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692315.612427:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 10000000:00010000:2.0:1787692315.612428:0:8438:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de1f1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692315.612435:0:8438:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787692315.612447:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec89c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+4:8499:x1874531125855104:12345-0@lo:104: 00010000:00010000:1.0:1787692315.612456:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de126 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692315.612474:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de1f1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692315.612482:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787692315.612496:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787692315.612502:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec89c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+4:8499:x1874531125855104:12345-0@lo:104: Request processed in 69us (317us total) trans 0 rc 0/0 00010000:00010000:2.0:1787692315.612508:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de1f1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692315.612509:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1787692315.612519:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb400/0x5d8b8560a09de1ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de1f1 expref: -99 pid: 7614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692315.612532:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692315.612536:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de126 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692315.612543:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787692315.612554:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+3:8499:x1874531125855232:12345-0@lo:104: 00010000:00010000:2.0:1787692315.612555:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3600 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:2.0:1787692315.612561:0:8438:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de126 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.612566:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec814a2800/0x5d8b8560a09de0bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de0c4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692315.612569:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de126 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787692315.612581:0:8438:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de126 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692315.612585:0:8438:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787692315.612601:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de126 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692315.612606:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787692315.612614:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de126 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692315.612620:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec814a3600/0x5d8b8560a09de11f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de126 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.612623:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787692315.612634:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692315.612638:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec814a2800/0x5d8b8560a09de0bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de0c4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692315.612644:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2800 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:2.0:1787692315.612646:0:8438:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a2800/0x5d8b8560a09de0bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de0c4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692315.612662:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec814a2800/0x5d8b8560a09de0bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de0c4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787692315.612668:0:8438:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a2800/0x5d8b8560a09de0bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de0c4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692315.612673:0:8438:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787692315.612687:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec814a2800/0x5d8b8560a09de0bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de0c4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692315.612693:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787692315.612707:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec814a2800/0x5d8b8560a09de0bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de0c4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692315.612714:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec814a2800/0x5d8b8560a09de0bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de0c4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692315.612725:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692315.612727:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692315.612728:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692315.612740:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125855488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787692315.612772:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692315.612791:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787692315.612797:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125855360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787692315.612846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692315.612875:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125855488 00000100:00100000:2.0:1787692315.612881:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125855488 00010000:00010000:2.0:1787692315.612899:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de126 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de11f expref: 19 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692315.612927:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125855360 00000100:00100000:2.0:1787692315.612930:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125855360 00010000:00010000:2.0:1787692315.612942:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ecc62ca200/0x5d8b8560a09de1f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de1ea expref: 20 pid: 5823 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692315.612961:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787692315.612967:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+20:3307:x1874531125855488:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787692315.613177:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:74f850a3-c102-416a-ae3b-08438aa77de6+3:8499:x1874531125855232:12345-0@lo:104: Request processed in 79us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692315.613186:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787692315.613213:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692315.613222:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125855616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787692315.613250:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787692315.614296:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692315.614319:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125855616 00000100:00100000:3.0:1787692315.614325:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125855616 00010000:00010000:3.0:1787692315.614358:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec80031600/0x5d8b8560a09de0c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de0bd expref: 21 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692315.614403:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787692315.614412:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+21:3307:x1874531125855360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692315.614423:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692315.614429:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ecc62ca200/0x5d8b8560a09de1f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de1ea expref: 21 pid: 5823 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692315.614438:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ecc62ca200/0x5d8b8560a09de1f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de1ea expref: 21 pid: 5823 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692315.614452:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecc62ca200/0x5d8b8560a09de1f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de1ea expref: 21 pid: 5823 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692315.614465:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692315.614523:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+20:3307:x1874531125855360:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692315.614541:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787692315.614557:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787692315.614562:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125855616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692315.614571:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692315.614575:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec80031600/0x5d8b8560a09de0c4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de0bd expref: 19 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692315.614581:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec80031600/0x5d8b8560a09de0c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de0bd expref: 19 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692315.614590:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692315.614619:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125855616:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692315.614625:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787692315.614664:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125855616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787692315.615126:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125855360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787692315.616407:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1874531125855104:0@lo:104: 00010000:00010000:0.0:1787692315.616424:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec80031600/0x5d8b8560a09de0c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de0bd expref: 18 pid: 5826 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692315.616438:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1874531125855232:0@lo:104: 00010000:00010000:0.0:1787692315.616791:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692315.616800:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de126 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de11f expref: 17 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692315.616828:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de126 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de11f expref: 17 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692315.616857:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de126 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de11f expref: 17 pid: 5825 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692315.616869:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692315.616929:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+16:3307:x1874531125855488:12345-0@lo:103:ldlm_bl.0 Request processed in 3962us (4155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692315.616937:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787692315.617314:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125855488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787692315.617653:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692315.617725:0:8499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8499:1874531125854848:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692315.617757:0:8499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692315.618441:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108001920 00000100:00100000:1.0:1787692315.618450:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108001920 00010000:00010000:1.0:1787692315.618484:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de2ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2147 expref: 10 pid: 5825 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692315.618522:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:1.0:1787692315.618531:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0696784b-1191-4b0f-b755-3a72c69e021b+10:2361:x1874531108001920:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787692315.618551:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692315.618557:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de2ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2147 expref: 10 pid: 5825 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.618568:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de2ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2147 expref: 10 pid: 5825 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.618584:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de2ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2147 expref: 10 pid: 5825 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.618599:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.618607:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.618626:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.618633:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.618654:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.618660:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.618666:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425c00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692315.618670:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.618678:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.618690:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692315.618698:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692315.618753:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0696784b-1191-4b0f-b755-3a72c69e021b+9:2361:x1874531108001920:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 223us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692315.618760:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 24 00010000:00010000:0.0:1787692315.619308:0:8499:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692315.619318:0:8499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692315.619324:0:8499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6425c00/0x5d8b8560a09de34f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692316.161477:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692316.192273:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692316.192383:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108002048 00000100:00100000:0.0:1787692316.192394:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108002048 00000100:00100000:0.0:1787692316.192461:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 170 00000100:00100000:0.0:1787692316.192471:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+9:5602:x1874531108002048:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692316.192485:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692316.192504:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de356 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2186 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692316.192708:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de356 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2186 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692316.192721:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de356 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2186 expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692316.192730:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6424e00, rc 0) 00000100:00100000:0.0:1787692316.192847:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:5602:x1874531108002048:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 378us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692316.192854:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 170 00000100:00100000:3.0:1787692316.198113:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692316.201762:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108002176 00000100:00100000:2.0:1787692316.201778:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108002176 00000100:00100000:2.0:1787692316.204143:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 171 00000100:00100000:2.0:1787692316.204160:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+10:5602:x1874531108002176:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692316.204484:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+10:5602:x1874531108002176:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 327us (6380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692316.204493:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 171 00000100:00100000:3.0:1787692316.210996:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692316.211032:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108002304 00000100:00100000:3.0:1787692316.211042:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108002304 00000100:00100000:3.0:1787692316.211085:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 172 00000100:00100000:3.0:1787692316.211094:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:5602:x1874531108002304:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787692316.211304:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:5602:x1874531108002304:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 210us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692316.211312:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 172 00000100:00100000:1.0:1787692316.232474:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692316.234000:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108002432 00000100:00100000:3.0:1787692316.234026:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108002432 00000100:00100000:3.0:1787692316.234167:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 173 00000100:00100000:3.0:1787692316.234178:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:6157:x1874531108002432:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787692316.234874:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:6157:x1874531108002432:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 694us (2407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692316.234885:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 173 00000100:00100000:0.0:1787692316.248934:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692316.249045:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108002560 00000100:00100000:2.0:1787692316.249057:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108002560 00000100:00100000:2.0:1787692316.249105:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 174 00000100:00100000:2.0:1787692316.249114:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+10:6157:x1874531108002560:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787692316.249608:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+10:6157:x1874531108002560:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 493us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692316.249617:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 174 00010000:00010000:2.0:1787692317.189064:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787692317.446275:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787692317.446283:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92eb85134000 from 4 10000000:01000000:3.0:1787692317.446288:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787692317.446330:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692317.446341:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692317.446353:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692317.446377:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125855744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787692317.446442:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692317.446502:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9068f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692317.446613:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125855744 00000100:00100000:0.0:1787692317.446620:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125855744 00000100:00100000:0.0:1787692317.446681:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787692317.446693:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125855744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692317.446706:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692317.446719:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de364 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de35d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692317.446741:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de35d expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692317.446751:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de35d expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692317.446759:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6424600, rc 0) 00000100:00100000:0.0:1787692317.446806:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125855744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692317.446849:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125855744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787692317.446849:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00010000:3.0:1787692317.446862:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de364 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692317.446870:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de364 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692317.446921:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125855872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787692317.446953:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692317.446988:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9068f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692317.447042:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125855872 00000100:00100000:0.0:1787692317.447046:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125855872 00000100:00100000:0.0:1787692317.447076:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787692317.447084:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125855872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787692317.447592:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125855872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 497us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692317.447602:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787692317.454353:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125855872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787692317.454417:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125856000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787692317.454570:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692317.454690:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9068f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692317.454712:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125856000 00000100:00100000:1.0:1787692317.454719:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125856000 00000100:00100000:1.0:1787692317.454772:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787692317.454781:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125856000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692317.455014:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125856000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692317.455022:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787692317.455163:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125856000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787692317.455504:0:8578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8578:1874531125856128:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787692317.455708:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692317.455740:0:8578:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a900 going to sleep for 11 seconds 00000100:00100000:1.0:1787692317.455784:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125856128 00000100:00100000:1.0:1787692317.455789:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125856128 00000100:00100000:2.0:1787692317.457825:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1787692317.457846:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:8578:x1874531125856128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787692317.458133:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:8578:x1874531125856128:12345-0@lo:502:llog_process_th.0 Request processed in 295us (2424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692317.458142:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787692317.458656:0:8578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8578:1874531125856128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787692317.458691:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787692317.458703:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692317.458706:0:8578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787692317.458714:0:8578:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92eb85134000 00000020:00000080:0.0:1787692317.458717:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787692317.458844:0:8578:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8578:1874531125856256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787692317.458911:0:8578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692317.458954:0:8578:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787692317.458982:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125856256 00000100:00100000:0.0:1787692317.458988:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125856256 00000100:00100000:0.0:1787692317.459037:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787692317.459047:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:8578:x1874531125856256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787692317.459213:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:8578:x1874531125856256:12345-0@lo:502:llog_process_th.0 Request processed in 168us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692317.459221:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787692317.459651:0:8578:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8578:1874531125856256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787692317.459678:0:8578:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692317.459685:0:8578:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692317.459687:0:8578:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787692317.459693:0:8578:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787692317.459902:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787692317.459926:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787692317.459942:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de364 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692317.459954:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de364 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692317.459984:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787692317.459987:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ecafbbe800 from 4 10000000:01000000:0.0:1787692317.459990:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787692317.460017:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692317.460026:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692317.460035:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692317.460053:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125856384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787692317.460093:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692317.460127:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692317.465718:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125856384 00000100:00100000:1.0:1787692317.465734:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125856384 00000100:00100000:1.0:1787692317.465798:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787692317.465836:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125856384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787692317.465854:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692317.465873:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de372 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de36b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692317.465902:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de36b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692317.465913:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de36b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692317.465923:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec813d7800, rc 0) 00000100:00100000:1.0:1787692317.466014:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125856384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (5919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692317.466021:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787692317.466076:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125856384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787692317.466095:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de372 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692317.466114:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de372 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692317.466195:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125856512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692317.466358:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692317.466390:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec83c12d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787692317.466405:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125856512 00000100:00100000:1.0:1787692317.466409:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125856512 00000100:00100000:1.0:1787692317.466435:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787692317.466442:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125856512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692317.466702:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125856512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692317.466711:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787692317.466752:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125856512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692317.466788:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125856640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692317.466898:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692317.466921:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec83c12d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787692317.466933:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125856640 00000100:00100000:1.0:1787692317.466937:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125856640 00000100:00100000:1.0:1787692317.466956:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787692317.466977:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125856640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692317.467134:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125856640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692317.467141:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787692317.467184:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125856640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692317.467358:0:8580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8580:1874531125856768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692317.467399:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692317.467418:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125856768 00000100:00100000:1.0:1787692317.467421:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125856768 00000100:00100000:1.0:1787692317.467447:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787692317.467455:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:8580:x1874531125856768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692317.467598:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:8580:x1874531125856768:12345-0@lo:502:llog_process_th.0 Request processed in 144us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692317.467605:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1787692317.467636:0:8580:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec83c12540 going to sleep for 11 seconds 00000100:00100000:1.0:1787692317.467649:0:8580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8580:1874531125856768:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787692317.467670:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787692317.467682:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692317.467685:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787692317.467694:0:8580:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ecafbbe800 00000020:00000080:1.0:1787692317.467697:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787692317.467769:0:8580:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8580:1874531125856896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692317.467805:0:8580:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692317.467861:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125856896 00000100:00100000:1.0:1787692317.467865:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125856896 00000100:00100000:1.0:1787692317.467891:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787692317.467898:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:8580:x1874531125856896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692317.468034:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:8580:x1874531125856896:12345-0@lo:502:llog_process_th.0 Request processed in 136us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692317.468041:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1787692317.468083:0:8580:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec83c12540 going to sleep for 11 seconds 00000100:00100000:1.0:1787692317.468096:0:8580:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8580:1874531125856896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787692317.468114:0:8580:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692317.468119:0:8580:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692317.468121:0:8580:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787692317.468125:0:8580:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787692317.468169:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787692317.468183:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787692317.468192:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de372 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692317.468202:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de372 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692317.468212:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787692317.468215:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ec9dbcc000 from 4 10000000:01000000:1.0:1787692317.468218:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787692317.468239:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692317.468247:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692317.468256:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692317.468269:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125857024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787692317.468295:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692317.468308:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec83c12540 going to sleep for 11 seconds 00000100:00100000:1.0:1787692317.468319:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125857024 00000100:00100000:1.0:1787692317.468328:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125857024 00000100:00100000:1.0:1787692317.468349:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1787692317.468355:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125857024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787692317.468364:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692317.468375:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec813d6e00/0x5d8b8560a09de380 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de379 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692317.468394:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec813d6e00/0x5d8b8560a09de380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de379 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692317.468404:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec813d6e00/0x5d8b8560a09de380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de379 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692317.468413:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec813d6e00, rc 0) 00000100:00100000:1.0:1787692317.476387:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125857024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 8022us (8082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692317.476399:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787692317.476515:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125857024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787692317.476539:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de380 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692317.476551:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de380 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692317.476623:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125857152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787692317.476659:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692317.476698:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9068fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787692317.476860:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125857152 00000100:00100000:1.0:1787692317.476867:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125857152 00000100:00100000:1.0:1787692317.476903:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787692317.476912:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125857152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692317.477169:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125857152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692317.477177:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787692317.477263:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125857152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787692317.477293:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125857280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787692317.477332:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692317.477358:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9068fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787692317.477411:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125857280 00000100:00100000:0.0:1787692317.477415:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125857280 00000100:00100000:0.0:1787692317.477454:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1787692317.477461:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125857280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787692317.477597:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125857280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 137us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692317.477604:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787692317.477675:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125857280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692317.478067:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8582:1874531125857408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692317.478107:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692317.478135:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec91dc1600 going to sleep for 11 seconds 00000100:00100000:0.0:1787692317.478314:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125857408 00000100:00100000:0.0:1787692317.478326:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125857408 00000100:00100000:0.0:1787692317.478363:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1787692317.478371:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:8582:x1874531125857408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787692317.478535:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:8582:x1874531125857408:12345-0@lo:502:llog_process_th.0 Request processed in 164us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692317.478542:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787692317.482030:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8582:1874531125857408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787692317.482095:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787692317.482107:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692317.482109:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787692317.482118:0:8582:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ec9dbcc000 00000020:00000080:1.0:1787692317.482121:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787692317.482240:0:8582:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8582:1874531125857536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692317.482316:0:8582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692317.482362:0:8582:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb22aad80 going to sleep for 11 seconds 00000100:00100000:0.0:1787692317.482870:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125857536 00000100:00100000:0.0:1787692317.482878:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125857536 00000100:00100000:0.0:1787692317.482932:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787692317.482943:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:8582:x1874531125857536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787692317.483194:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:8582:x1874531125857536:12345-0@lo:502:llog_process_th.0 Request processed in 253us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692317.483202:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787692317.483343:0:8582:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b41f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:8582:1874531125857536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787692317.483371:0:8582:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787692317.483378:0:8582:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692317.483386:0:8582:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787692317.483391:0:8582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787692317.483593:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787692317.483610:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787692317.483619:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de380 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692317.483630:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de380 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692318.212074:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692318.529534:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125858048:0@lo:400:kworker.0 00000100:00100000:3.0:1787692318.529609:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692318.529670:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787692318.529677:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125857664:0@lo:400:kworker.0 00000100:00100000:3.0:1787692318.529706:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692318.529729:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125858176:0@lo:400:kworker.0 00000100:00100000:3.0:1787692318.529753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692318.529788:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125857664 00000100:00100000:3.0:1787692318.529795:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125857664 00000100:00100000:3.0:1787692318.529849:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787692318.529856:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125857664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692318.529898:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125857664:12345-0@lo:400:kworker.0 Request processed in 42us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692318.529904:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787692318.529968:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125857664:0@lo:400:kworker.0 00000100:00100000:3.0:1787692318.529999:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125858176 00000100:00100000:3.0:1787692318.530002:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125858176 00000100:00100000:3.0:1787692318.530035:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787692318.530041:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125858176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692318.530072:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125858176:12345-0@lo:400:kworker.0 Request processed in 31us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692318.530078:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787692318.530090:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692318.530109:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125858176:0@lo:400:kworker.0 00000100:00100000:1.0:1787692318.532388:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125857792:0@lo:400:kworker.0 00000100:00100000:1.0:1787692318.532463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692318.532506:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125858304:0@lo:400:kworker.0 00000100:00100000:1.0:1787692318.532546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692318.532585:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787692318.532591:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125857920:0@lo:400:kworker.0 00000100:00100000:1.0:1787692318.532615:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692318.532655:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125858048 00000100:00100000:1.0:1787692318.532662:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125858048 00000100:00100000:1.0:1787692318.532710:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125858304 00000100:00100000:1.0:1787692318.532713:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125858304 00000100:00100000:1.0:1787692318.532736:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787692318.532745:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125858048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692318.532795:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125858048:12345-0@lo:400:kworker.0 Request processed in 51us (3186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692318.532802:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787692318.532850:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787692318.532856:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125858304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692318.532893:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125858304:12345-0@lo:400:kworker.0 Request processed in 37us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692318.532899:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787692318.532916:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125857792 00000100:00100000:1.0:1787692318.532920:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125857792 00000100:00100000:1.0:1787692318.532941:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125857920 00000100:00100000:1.0:1787692318.532943:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125857920 00000100:00100000:1.0:1787692318.532983:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787692318.532988:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125857792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692318.533013:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125857792:12345-0@lo:400:kworker.0 Request processed in 25us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692318.533018:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787692318.533028:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787692318.533034:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125857920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692318.533056:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125857920:12345-0@lo:400:kworker.0 Request processed in 23us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692318.533061:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1787692318.533086:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787692318.533090:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787692318.533092:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787692318.533116:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125857920:0@lo:400:kworker.0 00000100:00100000:1.0:1787692318.533126:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125857792:0@lo:400:kworker.0 00010000:00080000:1.0:1787692318.533142:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec878b0380 x1874531125858304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692318.533152:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125858304:0@lo:400:kworker.0 00010000:00080000:1.0:1787692318.533195:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec878b0a80 x1874531125858048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692318.533205:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125858048:0@lo:400:kworker.0 00000100:00100000:3.0:1787692319.041261:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692319.041287:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125858432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692319.041357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692319.042093:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125858432 00000100:00100000:1.0:1787692319.042102:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125858432 00000100:00100000:1.0:1787692319.042152:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787692319.042163:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125858432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787692319.042198:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692319.042268:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125858432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692319.042274:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787692319.042464:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf6e0e00 x1874531125858432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692319.042484:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125858432:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787692319.236473:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692319.397314:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692319.397364:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692319.397396:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692319.397426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692319.397459:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108002816 00000100:00100000:1.0:1787692319.397470:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108002816 00000100:00100000:3.0:1787692319.397474:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108002944 00000100:00100000:3.0:1787692319.397481:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108002944 00000100:00100000:1.0:1787692319.397549:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:1.0:1787692319.397559:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108002816:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692319.397632:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108002816:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692319.397639:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:1.0:1787692319.397663:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108003072 00000100:00100000:1.0:1787692319.397667:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108003072 00000100:00100000:2.0:1787692319.398163:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108002688 00000100:00100000:2.0:1787692319.398169:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108002688 00000100:00100000:2.0:1787692319.398205:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 191 00000100:00100000:2.0:1787692319.398212:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531108002688:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692319.398244:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531108002688:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 33us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692319.398251:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 191 00000100:00100000:3.0:1787692319.398432:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:3.0:1787692319.398441:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531108002944:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692319.398474:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5330700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531108002944:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 34us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692319.398480:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:1.0:1787692319.400318:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:1.0:1787692319.400334:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531108003072:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692319.400550:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531108003072:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 220us (3122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692319.400558:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00080000:2.0:1787692319.400970:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787692319.400975:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787692319.400979:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692320.065095:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787692320.065117:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125858560:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692320.065185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692320.065251:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125858560 00000100:00100000:0.0:1787692320.065260:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125858560 00000100:00100000:0.0:1787692320.065320:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787692320.065336:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125858560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787692320.065378:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692320.065421:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125858560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692320.065428:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787692320.065451:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787692320.065482:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf6e0000 x1874531125858560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692320.065502:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125858560:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787692320.260105:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692321.287118:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787692321.539559:0:8798:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1787692322.305190:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692323.330132:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692323.649272:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787692323.649302:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125858688:0@lo:400:kworker.0 00000100:00100000:1.0:1787692323.649549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692323.649763:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125858944:0@lo:400:kworker.0 00000100:00100000:3.0:1787692323.649803:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692323.649859:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787692323.649865:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125858816:0@lo:400:kworker.0 00000100:00100000:3.0:1787692323.649889:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692323.650034:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125859200:0@lo:400:kworker.0 00000100:00100000:3.0:1787692323.650227:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125859328:0@lo:400:kworker.0 00000100:00100000:3.0:1787692323.650258:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692323.650331:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125859328 00000100:00100000:1.0:1787692323.650342:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125859328 00000100:00100000:2.0:1787692323.650462:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125858688 00000100:00100000:2.0:1787692323.650483:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125858688 00000100:00100000:2.0:1787692323.650522:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1787692323.650534:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125858688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692323.650593:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125858688:12345-0@lo:400:kworker.0 Request processed in 61us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692323.650601:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787692323.655326:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125859072:0@lo:400:kworker.0 00000100:00100000:0.0:1787692323.655978:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692323.659601:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125858944 00000100:00100000:3.0:1787692323.659622:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125858944 00000100:00100000:3.0:1787692323.659703:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125858816 00000100:00100000:3.0:1787692323.659706:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125858816 00000100:00100000:3.0:1787692323.659751:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787692323.659763:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125858944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692323.659885:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125858944:12345-0@lo:400:kworker.0 Request processed in 124us (10080us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692323.659921:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787692323.659949:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787692323.659955:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125858816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692323.659988:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125858816:12345-0@lo:400:kworker.0 Request processed in 34us (10099us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692323.659994:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787692323.660051:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125858816:0@lo:400:kworker.0 00000100:00100000:3.0:1787692323.660064:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125858944:0@lo:400:kworker.0 00000100:00080000:3.0:1787692323.662692:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787692323.662708:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787692323.662767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692323.662881:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125859200 00000100:00100000:3.0:1787692323.662892:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125859200 00000100:00100000:3.0:1787692323.663097:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787692323.663120:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125859200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692323.663216:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125859200:12345-0@lo:400:kworker.0 Request processed in 109us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692323.663225:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1787692323.663245:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692323.663281:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125859200:0@lo:400:kworker.0 00000100:00100000:0.0:1787692323.666764:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125858688:0@lo:400:kworker.0 00000100:00100000:1.0:1787692323.667209:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125859072 00000100:00100000:1.0:1787692323.667220:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125859072 00000100:00100000:1.0:1787692323.667314:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787692323.667325:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125859328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692323.667437:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125859328:12345-0@lo:400:kworker.0 Request processed in 115us (17177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692323.667445:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787692323.667468:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787692323.667474:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125859072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692323.667511:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125859072:12345-0@lo:400:kworker.0 Request processed in 37us (11536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692323.667517:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1787692323.667540:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787692323.667571:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec878b1f80 x1874531125859328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692323.667587:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125859328:0@lo:400:kworker.0 00010000:00080000:1.0:1787692323.667625:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec878b0000 x1874531125859072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692323.667653:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125859072:0@lo:400:kworker.0 00000100:00100000:1.0:1787692324.162310:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125859456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787692324.162397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692324.163172:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125859456 00000100:00100000:0.0:1787692324.163279:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125859456 00000100:00100000:0.0:1787692324.163458:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787692324.163474:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125859456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787692324.163525:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692324.163619:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5331c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125859456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692324.163628:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787692324.163679:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb5333480 x1874531125859456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692324.163702:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125859456:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787692324.353498:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692324.516956:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692324.517001:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692324.517596:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108003200 00000100:00100000:2.0:1787692324.517609:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108003200 00000100:00100000:2.0:1787692324.517693:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 193 00000100:00100000:2.0:1787692324.517705:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531108003200:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692324.517839:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531108003200:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 111us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692324.517849:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 193 00000100:00100000:3.0:1787692324.521916:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108003328 00000100:00100000:3.0:1787692324.521948:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108003328 00000100:00100000:3.0:1787692324.522075:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:3.0:1787692324.522089:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108003328:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692324.522208:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108003328:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 123us (5205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692324.522370:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00080000:1.0:1787692324.522955:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692324.546950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692324.547099:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108003456 00000100:00100000:0.0:1787692324.547114:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108003456 00000100:00100000:0.0:1787692324.547193:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:0.0:1787692324.547230:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2360:x1874531108003456:12345-192.168.206.27@tcp:9:kworker.0 00000020:00000080:0.0:1787692324.547342:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de2bc 00000100:00080000:0.0:1787692324.547355:0:6681:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d52000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787692324.547407:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787692324.548633:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+2:2360:x1874531108003456:12345-192.168.206.27@tcp:9:kworker.0 Request processed in 1404us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692324.548647:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00080000:1.0:1787692324.548797:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787692324.548848:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692324.549528:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692324.549615:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108003584 00000100:00100000:3.0:1787692324.549625:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108003584 00000100:00080000:1.0:1787692324.549844:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787692324.550156:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:3.0:1787692324.550173:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+5:2360:x1874531108003584:12345-192.168.206.27@tcp:9:kworker.0 00000020:00000080:3.0:1787692324.550218:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de2c3 00000100:00080000:3.0:1787692324.550230:0:6680:0:(import.c:65:import_set_state_nolock()) ffff92ecc561e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787692324.550291:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787692324.550649:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+2:2360:x1874531108003584:12345-192.168.206.27@tcp:9:kworker.0 Request processed in 480us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692324.550658:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00010000:00010000:1.0:1787692324.551478:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787692324.738773:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 067f46f5-4779-40e6-b53d-5b3e89751501 00000020:00000080:2.0:1787692324.738785:0:6703:0:(genops.c:885:class_export_put()) final put ffff92ecb4d56000/067f46f5-4779-40e6-b53d-5b3e89751501 00000020:00000080:0.0:1787692324.739561:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecb4d56000/067f46f5-4779-40e6-b53d-5b3e89751501 for lustre-OST0000 00000020:00000080:0.0:1787692324.739706:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ecb4d52000 for lustre-OST0000 00000100:00100000:1.0:1787692325.187701:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125859584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787692325.187790:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692325.188003:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125859584 00000100:00100000:2.0:1787692325.188012:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125859584 00000100:00100000:2.0:1787692325.188082:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787692325.188091:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125859584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787692325.188128:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692325.188187:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125859584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692325.188194:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1787692325.188315:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787692325.188495:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaed7c000 x1874531125859584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692325.188517:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125859584:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787692325.379910:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692326.401037:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787692327.394042:0:9042:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing yml_node 00010000:00010000:2.0:1787692327.425567:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787692327.827869:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 067f46f5-4779-40e6-b53d-5b3e89751501 00000020:00000080:3.0:1787692327.827879:0:7630:0:(genops.c:885:class_export_put()) final put ffff92ecb4d3e000/067f46f5-4779-40e6-b53d-5b3e89751501 00000020:00000080:1.0:1787692327.828000:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecb4d3e000/067f46f5-4779-40e6-b53d-5b3e89751501 for lustre-OST0001 00000020:00000080:1.0:1787692327.828050:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ecc561e000 for lustre-OST0001 00010000:00010000:2.0:1787692328.449457:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692328.770741:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125860096:0@lo:400:kworker.0 00000100:00100000:1.0:1787692328.770835:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692328.771130:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125859712:0@lo:400:kworker.0 00000100:00100000:3.0:1787692328.771165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692328.771229:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125859712 00000100:00100000:2.0:1787692328.771238:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125859712 00000100:00100000:2.0:1787692328.771291:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787692328.771301:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125859712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692328.771357:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125859712:12345-0@lo:400:kworker.0 Request processed in 58us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692328.771365:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787692328.771512:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125859712:0@lo:400:kworker.0 00000100:00100000:2.0:1787692328.771520:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125860224:0@lo:400:kworker.0 00000100:00100000:2.0:1787692328.771546:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692328.771663:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125860224 00000100:00100000:3.0:1787692328.771668:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125860224 00000100:00100000:3.0:1787692328.771725:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787692328.771733:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125860224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692328.771840:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125859840:0@lo:400:kworker.0 00000100:00100000:1.0:1787692328.771881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692328.771913:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125860352:0@lo:400:kworker.0 00000100:00100000:1.0:1787692328.771939:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692328.774439:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125860224:12345-0@lo:400:kworker.0 Request processed in 2697us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692328.774453:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787692328.774483:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125859840 00000100:00100000:3.0:1787692328.774491:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125859840 00000100:00100000:3.0:1787692328.774531:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787692328.774539:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125859840:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787692328.774994:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692328.775038:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125860224:0@lo:400:kworker.0 00000100:00100000:1.0:1787692328.775764:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787692328.775778:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125859968:0@lo:400:kworker.0 00000100:00100000:0.0:1787692328.776066:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125860096 00000100:00100000:0.0:1787692328.776072:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125860096 00000100:00100000:0.0:1787692328.776116:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125860352 00000100:00100000:0.0:1787692328.776120:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125860352 00000100:00100000:0.0:1787692328.776146:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787692328.776164:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125860096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692328.776235:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787692328.776245:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125860352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692328.777756:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125859840:12345-0@lo:400:kworker.0 Request processed in 3209us (5877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692328.777769:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787692328.778111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692328.778182:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125859840:0@lo:400:kworker.0 00000100:00100000:1.0:1787692328.778222:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125859968 00000100:00100000:1.0:1787692328.778228:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125859968 00000100:00100000:1.0:1787692328.778273:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787692328.778281:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125859968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692328.778331:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125859968:12345-0@lo:400:kworker.0 Request processed in 51us (220us total) trans 0 rc 0/0 00000100:00080000:3.0:1787692328.778337:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692328.778337:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1787692328.778341:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787692328.778343:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787692328.778600:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125860096:12345-0@lo:400:kworker.0 Request processed in 2445us (7786us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692328.778610:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787692328.779102:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb5333100 x1874531125860096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692328.779116:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125860096:0@lo:400:kworker.0 00000100:00100000:2.0:1787692328.781080:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125860352:12345-0@lo:400:kworker.0 Request processed in 4828us (9130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692328.781094:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787692328.782309:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125859968:0@lo:400:kworker.0 00010000:00080000:1.0:1787692328.782328:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb5331500 x1874531125860352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692328.782339:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125860352:0@lo:400:kworker.0 00000100:00100000:3.0:1787692329.281277:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692329.281308:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125860480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692329.281376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692329.281557:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125860480 00000100:00100000:0.0:1787692329.281565:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125860480 00000100:00100000:0.0:1787692329.281618:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787692329.281629:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125860480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787692329.281663:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692329.281719:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125860480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692329.281726:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1787692329.281974:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb5331500 x1874531125860480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692329.281993:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125860480:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787692329.473116:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692329.643443:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692329.643495:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692329.643883:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108003712 00000100:00100000:0.0:1787692329.643893:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108003712 00000100:00100000:0.0:1787692329.643971:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 195 00000100:00100000:0.0:1787692329.643982:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531108003712:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692329.644061:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531108003712:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 81us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692329.644069:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 195 00000100:00100000:1.0:1787692329.646534:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108003840 00000100:00100000:1.0:1787692329.646549:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108003840 00000100:00100000:1.0:1787692329.646646:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:1.0:1787692329.646658:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108003840:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692329.646749:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108003840:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 95us (3254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692329.646757:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00080000:3.0:1787692329.646988:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692330.305435:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787692330.305460:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125860608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692330.305533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692330.305697:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125860608 00000100:00100000:1.0:1787692330.305705:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125860608 00000100:00100000:1.0:1787692330.305778:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787692330.305788:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125860608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787692330.305846:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692330.305903:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125860608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (358us total) trans 0 rc 0/0 00000100:00080000:2.0:1787692330.306024:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787692330.306060:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787692330.306210:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaed7d880 x1874531125860608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692330.306229:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125860608:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787692330.497039:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692331.521272:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787692332.486687:0:9237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.80 00010000:00010000:2.0:1787692332.549597:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692333.570352:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692333.889243:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125860992:0@lo:400:kworker.0 00000100:00100000:0.0:1787692333.889318:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692333.889393:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787692333.889400:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125860864:0@lo:400:kworker.0 00000100:00100000:0.0:1787692333.889425:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692333.889445:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125861376:0@lo:400:kworker.0 00000100:00100000:0.0:1787692333.889467:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692333.889500:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125860992 00000100:00100000:0.0:1787692333.889506:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125860992 00000100:00100000:0.0:1787692333.889555:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125860864 00000100:00100000:0.0:1787692333.889558:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125860864 00000100:00100000:0.0:1787692333.889584:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787692333.889608:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125860992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692333.889660:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125860992:12345-0@lo:400:kworker.0 Request processed in 56us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692333.889668:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787692333.889686:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787692333.889694:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125860864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692333.889721:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125860864:12345-0@lo:400:kworker.0 Request processed in 30us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692333.889728:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1787692333.889743:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692333.889773:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125860864:0@lo:400:kworker.0 00000100:00100000:0.0:1787692333.889783:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125860992:0@lo:400:kworker.0 00000100:00100000:3.0:1787692333.890111:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125861120:0@lo:400:kworker.0 00000100:00100000:3.0:1787692333.890143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692333.890169:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787692333.890175:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125860736:0@lo:400:kworker.0 00000100:00100000:3.0:1787692333.890201:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692333.890223:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125861248:0@lo:400:kworker.0 00000100:00100000:3.0:1787692333.890243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692333.890270:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125861376 00000100:00100000:3.0:1787692333.890274:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125861376 00000100:00100000:3.0:1787692333.890313:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125861120 00000100:00100000:3.0:1787692333.890316:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125861120 00000100:00100000:3.0:1787692333.890338:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787692333.890345:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125861376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692333.890384:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125861376:12345-0@lo:400:kworker.0 Request processed in 40us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692333.890390:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787692333.890404:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787692333.890410:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125861120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692333.890443:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125861120:12345-0@lo:400:kworker.0 Request processed in 34us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692333.890449:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787692333.890466:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125860736 00000100:00100000:3.0:1787692333.890470:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125860736 00000100:00100000:3.0:1787692333.890493:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787692333.890500:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125860736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692333.890528:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125860736:12345-0@lo:400:kworker.0 Request processed in 29us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692333.890543:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787692333.890570:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125861248 00000100:00100000:3.0:1787692333.890574:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125861248 00000100:00100000:3.0:1787692333.890600:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787692333.890606:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125861248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692333.890637:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125861248:12345-0@lo:400:kworker.0 Request processed in 31us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692333.890643:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1787692333.890667:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787692333.890671:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787692333.890673:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787692333.890689:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125860736:0@lo:400:kworker.0 00000100:00100000:3.0:1787692333.890700:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125861248:0@lo:400:kworker.0 00010000:00080000:3.0:1787692333.890711:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf6e1500 x1874531125861120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692333.890720:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125861120:0@lo:400:kworker.0 00010000:00080000:3.0:1787692333.890753:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf6e2680 x1874531125861376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692333.890762:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125861376:0@lo:400:kworker.0 00000100:00100000:3.0:1787692334.401549:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125861504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692334.401622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692334.401728:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125861504 00000100:00100000:1.0:1787692334.401736:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125861504 00000100:00100000:1.0:1787692334.401782:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787692334.401790:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125861504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787692334.401843:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692334.401895:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125861504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692334.401901:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1787692334.402363:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb5332680 x1874531125861504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692334.402382:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125861504:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787692334.593024:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692334.755594:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692334.755647:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692334.755763:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108003968 00000100:00100000:0.0:1787692334.755778:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108003968 00000100:00100000:0.0:1787692334.756147:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 197 00000100:00100000:0.0:1787692334.756162:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531108003968:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692334.756275:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531108003968:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 118us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692334.756283:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 197 00000100:00100000:0.0:1787692334.756318:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108004096 00000100:00100000:0.0:1787692334.756323:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108004096 00000100:00100000:0.0:1787692334.756357:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:0.0:1787692334.756365:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108004096:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692334.756393:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108004096:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 30us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692334.756413:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00080000:3.0:1787692334.756469:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787692334.821222:0:9334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.80 00000100:00100000:2.0:1787692335.425009:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787692335.425204:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125861632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787692335.425351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692335.425522:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125861632 00000100:00100000:1.0:1787692335.425530:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125861632 00000100:00100000:1.0:1787692335.425703:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787692335.425716:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125861632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787692335.425765:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692335.425850:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125861632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692335.425857:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787692335.425926:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787692335.426370:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaed7df80 x1874531125861632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692335.426396:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125861632:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787692335.617042:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692336.641199:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787692337.292344:0:9432:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.80 00010000:00010000:3.0:1787692337.665721:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692338.695727:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787692338.765706:0:9480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Aug 25 17:12:17 EDT 2026 00000100:00100000:2.0:1787692339.011772:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125861760:0@lo:400:kworker.0 00000100:00100000:2.0:1787692339.011882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692339.011949:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125862272:0@lo:400:kworker.0 00000100:00100000:3.0:1787692339.011954:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125862144:0@lo:400:kworker.0 00000100:00100000:2.0:1787692339.011977:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692339.011999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692339.012016:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125862144 00000100:00100000:2.0:1787692339.012024:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125862144 00000100:00100000:3.0:1787692339.012029:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125862016:0@lo:400:kworker.0 00000100:00100000:3.0:1787692339.012063:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692339.012075:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787692339.012084:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125862144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692339.012087:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787692339.012092:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125861888:0@lo:400:kworker.0 00000100:00100000:3.0:1787692339.012111:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692339.012128:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125862400:0@lo:400:kworker.0 00000100:00100000:2.0:1787692339.012128:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125862144:12345-0@lo:400:kworker.0 Request processed in 44us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692339.012135:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787692339.012145:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692339.012173:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125862272 00000100:00100000:3.0:1787692339.012177:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125862272 00000100:00100000:1.0:1787692339.012195:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125861760 00000100:00100000:1.0:1787692339.012199:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125861760 00000100:00100000:3.0:1787692339.012203:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125862016 00000100:00100000:3.0:1787692339.012205:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125862016 00000100:00100000:1.0:1787692339.012221:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787692339.012227:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125861888 00000100:00100000:1.0:1787692339.012227:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125861760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692339.012229:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125861888 00000100:00100000:3.0:1787692339.012241:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787692339.012246:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125862272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692339.012269:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125861760:12345-0@lo:400:kworker.0 Request processed in 42us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692339.012270:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125862272:12345-0@lo:400:kworker.0 Request processed in 25us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692339.012276:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787692339.012276:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787692339.012288:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787692339.012293:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125862016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692339.012318:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125862272:0@lo:400:kworker.0 00000100:00100000:3.0:1787692339.012320:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125862016:12345-0@lo:400:kworker.0 Request processed in 27us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692339.012327:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125861760:0@lo:400:kworker.0 00000100:00100000:3.0:1787692339.012334:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787692339.012345:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787692339.012351:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125861888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692339.012379:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125861888:12345-0@lo:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692339.012384:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787692339.013550:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125862400 00000100:00100000:2.0:1787692339.013563:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125862400 00000100:00100000:2.0:1787692339.013636:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787692339.013645:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125862400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692339.013721:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125862400:12345-0@lo:400:kworker.0 Request processed in 77us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692339.013727:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1787692339.013750:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787692339.013755:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787692339.013757:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787692339.014024:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb5331880 x1874531125862144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692339.014039:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125862144:0@lo:400:kworker.0 00000100:00100000:3.0:1787692339.015043:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125861888:0@lo:400:kworker.0 00010000:00080000:3.0:1787692339.015061:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeed9c00 x1874531125862400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692339.015072:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125862400:0@lo:400:kworker.0 00000100:00100000:3.0:1787692339.015083:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125862016:0@lo:400:kworker.0 00000100:00100000:0.0:1787692339.521757:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692339.521780:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125862528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787692339.521902:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692339.522029:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125862528 00000100:00100000:1.0:1787692339.522037:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125862528 00000100:00100000:1.0:1787692339.522085:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787692339.522094:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125862528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787692339.522128:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692339.522176:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125862528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692339.522183:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1787692339.522280:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeedb480 x1874531125862528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692339.522299:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125862528:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787692339.712971:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692339.871950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692339.871998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692339.872077:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108004224 00000100:00100000:3.0:1787692339.872087:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108004224 00000100:00100000:3.0:1787692339.872151:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 199 00000100:00100000:3.0:1787692339.872161:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+10:2364:x1874531108004224:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692339.872245:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+10:2364:x1874531108004224:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 84us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692339.872252:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 199 00000100:00100000:0.0:1787692339.872347:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108004352 00000100:00100000:0.0:1787692339.872352:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108004352 00000100:00100000:0.0:1787692339.872424:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:0.0:1787692339.872434:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2364:x1874531108004352:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692339.872468:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2364:x1874531108004352:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 37us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692339.872475:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00080000:3.0:1787692339.872581:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692340.548384:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125862656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787692340.548475:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692340.548944:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125862656 00000100:00100000:0.0:1787692340.548952:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125862656 00000100:00100000:0.0:1787692340.549029:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787692340.549422:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125862656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787692340.549463:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692340.549544:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125862656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 506us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692340.549564:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787692340.549583:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf6e1180 x1874531125862656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692340.549605:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125862656:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787692340.739548:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692341.760984:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692342.789642:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692343.809055:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692344.134173:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125862784:0@lo:400:kworker.0 00000100:00100000:0.0:1787692344.134246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692344.134301:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125863296:0@lo:400:kworker.0 00000100:00100000:0.0:1787692344.134328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692344.134352:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787692344.134358:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125863168:0@lo:400:kworker.0 00000100:00100000:0.0:1787692344.134383:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692344.134413:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125862912:0@lo:400:kworker.0 00000100:00100000:0.0:1787692344.134436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692344.134451:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125863424:0@lo:400:kworker.0 00000100:00100000:0.0:1787692344.134470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692344.134487:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692344.134493:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125863040:0@lo:400:kworker.0 00000100:00100000:0.0:1787692344.134514:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692344.134546:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125862784 00000100:00100000:0.0:1787692344.134552:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125862784 00000100:00100000:0.0:1787692344.134600:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787692344.134610:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125862784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692344.134652:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125862784:12345-0@lo:400:kworker.0 Request processed in 45us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692344.134659:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787692344.134686:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125863168 00000100:00100000:0.0:1787692344.134690:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125863168 00000100:00100000:0.0:1787692344.134721:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125863424 00000100:00100000:0.0:1787692344.134723:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125863424 00000100:00100000:0.0:1787692344.134741:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787692344.134750:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125863168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692344.134780:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125863168:12345-0@lo:400:kworker.0 Request processed in 33us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692344.134795:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787692344.134807:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787692344.134847:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125863424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692344.135609:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125863424:12345-0@lo:400:kworker.0 Request processed in 793us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692344.135618:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787692344.135647:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125863296 00000100:00100000:0.0:1787692344.135653:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125863296 00000100:00100000:0.0:1787692344.135691:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125862912 00000100:00100000:0.0:1787692344.135694:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125862912 00000100:00100000:0.0:1787692344.135715:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125863040 00000100:00100000:0.0:1787692344.135718:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125863040 00000100:00100000:0.0:1787692344.135733:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787692344.135740:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125863296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692344.136026:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787692344.136095:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787692344.136104:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125863040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692344.136153:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125863040:12345-0@lo:400:kworker.0 Request processed in 51us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692344.136159:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787692344.136842:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125863296:12345-0@lo:400:kworker.0 Request processed in 1099us (2509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692344.136851:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1787692344.136912:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf6e2680 x1874531125863168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692344.136927:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125863168:0@lo:400:kworker.0 00000100:00100000:0.0:1787692344.136940:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125862784:0@lo:400:kworker.0 00000100:00100000:0.0:1787692344.136951:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125863296:0@lo:400:kworker.0 00000100:00080000:0.0:1787692344.136976:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787692344.136982:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787692344.136985:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787692344.137024:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125863040:0@lo:400:kworker.0 00010000:00080000:0.0:1787692344.137038:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf6e3100 x1874531125863424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692344.137046:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125863424:0@lo:400:kworker.0 00000100:00100000:1.0:1787692344.137522:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125862912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692344.137599:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125862912:12345-0@lo:400:kworker.0 Request processed in 1565us (3162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692344.137606:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787692344.138560:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125862912:0@lo:400:kworker.0 00000100:00100000:2.0:1787692344.641063:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787692344.641090:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125863552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787692344.641182:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692344.641319:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125863552 00000100:00100000:0.0:1787692344.641327:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125863552 00000100:00100000:0.0:1787692344.641385:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787692344.641397:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125863552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787692344.641435:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692344.641491:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125863552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692344.641498:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1787692344.641578:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf6e2300 x1874531125863552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692344.641599:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125863552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787692344.834707:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692345.000835:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692345.000892:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692345.002421:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108004608 00000100:00100000:0.0:1787692345.002436:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108004608 00000100:00100000:0.0:1787692345.002545:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:0.0:1787692345.002563:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeeda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108004608:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692345.002642:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeeda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108004608:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 88us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692345.002649:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00080000:1.0:1787692345.002975:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692345.006777:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108004480 00000100:00100000:3.0:1787692345.010297:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108004480 00000100:00100000:3.0:1787692345.016355:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 201 00000100:00100000:3.0:1787692345.016377:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531108004480:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692345.016483:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531108004480:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 114us (15682us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692345.016490:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 201 00000100:00100000:2.0:1787692345.665254:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125863680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787692345.665345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692345.665490:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125863680 00000100:00100000:1.0:1787692345.665498:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125863680 00000100:00100000:1.0:1787692345.665553:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787692345.665563:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125863680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787692345.665597:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692345.665640:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125863680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692345.665648:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787692345.665682:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeed8a80 x1874531125863680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692345.665700:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125863680:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787692345.857148:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692346.882287:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692347.908540:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692348.931964:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692349.249151:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125863808:0@lo:400:kworker.0 00000100:00100000:3.0:1787692349.249201:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125864192:0@lo:400:kworker.0 00000100:00100000:1.0:1787692349.249227:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692349.249230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692349.249269:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125863936:0@lo:400:kworker.0 00000100:00100000:0.0:1787692349.249277:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125863808 00000100:00100000:0.0:1787692349.249285:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125863808 00000100:00100000:3.0:1787692349.249295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692349.249315:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125864064:0@lo:400:kworker.0 00000100:00100000:3.0:1787692349.249336:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692349.249338:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787692349.249349:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125863808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692349.249413:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125863808:12345-0@lo:400:kworker.0 Request processed in 67us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692349.249421:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787692349.249454:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125864192 00000100:00100000:0.0:1787692349.249458:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125864192 00000100:00100000:0.0:1787692349.249507:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787692349.249514:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125864192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692349.249550:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125864192:12345-0@lo:400:kworker.0 Request processed in 37us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692349.249556:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787692349.249573:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125863936 00000100:00100000:0.0:1787692349.249577:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125863936 00000100:00100000:0.0:1787692349.249601:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125864064 00000100:00100000:0.0:1787692349.249604:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125864064 00000100:00100000:0.0:1787692349.249623:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787692349.249630:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125863936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692349.249666:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125863936:12345-0@lo:400:kworker.0 Request processed in 37us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692349.249673:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787692349.249685:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787692349.249692:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125864064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692349.249723:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125864064:12345-0@lo:400:kworker.0 Request processed in 33us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692349.249730:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787692349.249943:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125863808:0@lo:400:kworker.0 00000100:00100000:1.0:1787692349.249966:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125864320:0@lo:400:kworker.0 00000100:00100000:1.0:1787692349.249993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692349.250064:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125864320 00000100:00100000:0.0:1787692349.250068:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125864320 00000100:00100000:0.0:1787692349.250103:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787692349.250120:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125864320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692349.250158:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125864320:12345-0@lo:400:kworker.0 Request processed in 41us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692349.250164:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1787692349.250198:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb4f50a80 x1874531125864192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692349.250210:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125864192:0@lo:400:kworker.0 00000100:00100000:0.0:1787692349.250236:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125863936:0@lo:400:kworker.0 00000100:00100000:0.0:1787692349.250243:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125864448:0@lo:400:kworker.0 00000100:00100000:0.0:1787692349.250266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692349.250296:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125864448 00000100:00100000:0.0:1787692349.250300:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125864448 00000100:00100000:0.0:1787692349.250327:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787692349.250335:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125864448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692349.250575:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125864448:12345-0@lo:400:kworker.0 Request processed in 241us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692349.250582:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787692349.250616:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125864064:0@lo:400:kworker.0 00000100:00100000:0.0:1787692349.250642:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125864320:0@lo:400:kworker.0 00010000:00080000:1.0:1787692349.250706:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb4f52d80 x1874531125864448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692349.250715:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125864448:0@lo:400:kworker.0 00000100:00080000:3.0:1787692349.250804:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787692349.250809:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787692349.250832:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787692349.761047:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692349.761070:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125864576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692349.761142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692349.761241:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125864576 00000100:00100000:1.0:1787692349.761248:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125864576 00000100:00100000:1.0:1787692349.761303:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787692349.761325:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125864576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787692349.761361:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692349.761408:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125864576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692349.761415:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787692349.761488:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeedaa00 x1874531125864576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692349.761506:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125864576:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787692349.957215:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692350.118439:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692350.118484:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692350.118510:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108004736 00000100:00100000:3.0:1787692350.118520:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108004736 00000100:00100000:3.0:1787692350.118566:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 203 00000100:00100000:3.0:1787692350.118576:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531108004736:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692350.119889:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108004864 00000100:00100000:1.0:1787692350.119900:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108004864 00000100:00100000:1.0:1787692350.119974:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:1.0:1787692350.119984:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108004864:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692350.120062:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108004864:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 79us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692350.120069:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00080000:1.0:1787692350.120090:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692350.120946:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+10:2362:x1874531108004736:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 2365us (2510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692350.120957:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 203 00000100:00100000:3.0:1787692350.786015:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125864704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787692350.786085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692350.786199:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125864704 00000100:00100000:1.0:1787692350.786209:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125864704 00000100:00100000:1.0:1787692350.786575:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787692350.786586:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125864704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787692350.786622:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692350.786676:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125864704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692350.786684:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787692350.786895:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeedad80 x1874531125864704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692366 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692350.786915:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125864704:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787692350.977408:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692352.003503:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787692352.859076:0:10110:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 17:12:31 (1787692351) === 00010000:00010000:0.0:1787692353.029273:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692353.340779:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692353.341028:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108004992 00000100:00100000:0.0:1787692353.341037:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108004992 00000100:00100000:0.0:1787692353.341112:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 204 00000100:00100000:0.0:1787692353.341122:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+10:8157:x1874531108004992:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787692353.341148:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692353.341165:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b218d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692353.341193:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b218d expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692353.341204:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b218d expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692353.341212:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425a00, rc 0) 00000100:00100000:0.0:1787692353.341265:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+11:8157:x1874531108004992:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 144us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692353.341271:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 204 00000100:00100000:2.0:1787692353.354362:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692353.354482:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108005120 00000100:00100000:3.0:1787692353.354497:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108005120 00000100:00100000:3.0:1787692353.354636:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 205 00000100:00100000:3.0:1787692353.354652:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+11:8157:x1874531108005120:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787692353.355517:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+11:8157:x1874531108005120:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 863us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692353.355529:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 205 00000100:00100000:2.0:1787692353.364719:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692353.365015:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108005248 00000100:00100000:3.0:1787692353.365029:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108005248 00000100:00100000:3.0:1787692353.365106:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 206 00000100:00100000:3.0:1787692353.365119:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+11:8157:x1874531108005248:12345-192.168.206.27@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787692353.365424:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+11:8157:x1874531108005248:12345-192.168.206.27@tcp:503:mount.lustre.0 Request processed in 305us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692353.365433:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 206 00000100:00100000:1.0:1787692353.375358:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692353.377148:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108005376 00000100:00100000:3.0:1787692353.377167:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108005376 00000100:00100000:3.0:1787692353.377310:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 207 00000100:00100000:3.0:1787692353.377323:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+11:8161:x1874531108005376:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787692353.377702:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+11:8161:x1874531108005376:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 380us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692353.377712:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 207 00000100:00100000:2.0:1787692353.406482:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692353.406678:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108005504 00000100:00100000:0.0:1787692353.406692:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108005504 00000100:00100000:0.0:1787692353.406955:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 208 00000100:00100000:0.0:1787692353.406971:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+11:8161:x1874531108005504:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787692353.407430:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+11:8161:x1874531108005504:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 363us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692353.407441:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 208 00000100:00100000:2.0:1787692353.414348:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692353.414597:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108005632 00000100:00100000:3.0:1787692353.414611:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108005632 00000100:00100000:3.0:1787692353.414688:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 209 00000100:00100000:3.0:1787692353.414701:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+11:8157:x1874531108005632:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787692353.414728:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692353.414763:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec8b35a200/0x5d8b8560a09de38e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b21b7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692353.414808:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec8b35a200/0x5d8b8560a09de38e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21b7 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692353.414871:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec8b35a200/0x5d8b8560a09de38e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21b7 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692353.414882:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35a200, rc 0) 00000100:00100000:3.0:1787692353.414958:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+12:8157:x1874531108005632:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 259us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692353.414966:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 209 00000100:00100000:1.0:1787692353.423123:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692353.423328:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108005760 00000100:00100000:3.0:1787692353.423356:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108005760 00000100:00100000:3.0:1787692353.423435:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 210 00000100:00100000:3.0:1787692353.423447:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+12:8157:x1874531108005760:12345-192.168.206.27@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787692353.423479:0:5823:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787692353.423499:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787692353.423504:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787692353.423508:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787692353.423510:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787692353.427049:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+12:8157:x1874531108005760:12345-192.168.206.27@tcp:256:mount.lustre.0 Request processed in 3587us (3925us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692353.427065:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 210 00000100:00100000:2.0:1787692353.430990:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692353.434992:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108005888 00000100:00100000:0.0:1787692353.435014:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108005888 00000100:00100000:0.0:1787692353.435123:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 211 00000100:00100000:0.0:1787692353.435137:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+12:8157:x1874531108005888:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787692353.435160:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692353.435202:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de395 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b21be expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692353.435240:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21be expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692353.435254:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21be expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692353.435267:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425800, rc 0) 00000100:00100000:0.0:1787692353.435473:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:8157:x1874531108005888:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 339us (4496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692353.435481:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 211 00000100:00100000:1.0:1787692353.438387:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692353.438563:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108006016 00000100:00100000:3.0:1787692353.438576:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108006016 00000100:00100000:3.0:1787692353.438646:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 212 00000100:00100000:3.0:1787692353.438659:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:8157:x1874531108006016:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787692353.439052:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:8157:x1874531108006016:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 394us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692353.439061:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 212 00000100:00100000:2.0:1787692353.449119:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692353.449228:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108006144 00000100:00100000:3.0:1787692353.449238:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108006144 00000100:00100000:3.0:1787692353.449368:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 213 00000100:00100000:3.0:1787692353.449380:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:8157:x1874531108006144:12345-192.168.206.27@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787692353.449591:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:8157:x1874531108006144:12345-192.168.206.27@tcp:503:mount.lustre.0 Request processed in 212us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692353.449599:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 213 00000100:00100000:2.0:1787692353.453662:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692353.454092:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108006272 00000100:00100000:0.0:1787692353.454101:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108006272 00000100:00100000:0.0:1787692353.454166:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 214 00000100:00100000:0.0:1787692353.454175:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:8164:x1874531108006272:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787692353.454439:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:8164:x1874531108006272:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 264us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692353.454448:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 214 00000100:00100000:1.0:1787692353.459260:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692353.459578:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108006400 00000100:00100000:3.0:1787692353.459589:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108006400 00000100:00100000:3.0:1787692353.459660:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 215 00000100:00100000:3.0:1787692353.459670:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:8164:x1874531108006400:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787692353.459956:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:8164:x1874531108006400:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 286us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692353.459965:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 215 00000100:00100000:2.0:1787692353.465759:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692353.471498:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692353.471652:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108006912 00000100:00100000:2.0:1787692353.471662:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108006912 00000100:00100000:2.0:1787692353.471724:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108006528 00000100:00100000:2.0:1787692353.471727:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108006528 00000100:00100000:2.0:1787692353.471756:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:2.0:1787692353.471775:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:2364:x1874531108006912:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692353.471867:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:2364:x1874531108006912:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 103us (6544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692353.471876:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:2.0:1787692353.471894:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:2.0:1787692353.471899:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1874531108006528:12345-192.168.206.27@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787692353.471921:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 749d9e33-d584-4e2f-a596-9a00b88adda5@192.168.206.27@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:2.0:1787692353.471969:0:5832:0:(genops.c:1385:class_connect()) connect: client 749d9e33-d584-4e2f-a596-9a00b88adda5, cookie 0x5d8b8560a09de39c 00000004:00100000:2.0:1787692353.471998:0:5832:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787692353.472497:0:5832:0:(import.c:65:import_set_state_nolock()) ffff92ec904d8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787692353.472531:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:749d9e33-d584-4e2f-a596-9a00b88adda5+6:2360:x1874531108006528:12345-192.168.206.27@tcp:38:mount.lustre.0 Request processed in 630us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692353.472537:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00080000:3.0:1787692353.473094:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692353.491983:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692353.492026:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692353.492203:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108006656 00000100:00100000:1.0:1787692353.492213:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108006656 00000100:00100000:1.0:1787692353.492279:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108006784 00000100:00100000:1.0:1787692353.492282:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108006784 00000100:00100000:1.0:1787692353.492308:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:1.0:1787692353.492318:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+7:0:x1874531108006656:12345-192.168.206.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787692353.492372:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787692353.492466:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+7:0:x1874531108006656:12345-192.168.206.27@tcp:41:mount.lustre.0 Request processed in 149us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692353.492473:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:1.0:1787692353.492492:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:1.0:1787692353.492499:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+6:8157:x1874531108006784:12345-192.168.206.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787692353.492510:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787692353.492552:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+6:8157:x1874531108006784:12345-192.168.206.27@tcp:41:mount.lustre.0 Request processed in 53us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692353.492559:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00080000:3.0:1787692353.494311:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692353.495250:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692353.499640:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108007040 00000100:00100000:1.0:1787692353.499655:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108007040 00000100:00100000:1.0:1787692353.499991:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:1.0:1787692353.500002:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+6:8157:x1874531108007040:12345-192.168.206.27@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787692353.500147:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+6:8157:x1874531108007040:12345-192.168.206.27@tcp:40:mount.lustre.0 Request processed in 147us (4906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692353.500155:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:1.0:1787692353.503998:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692353.504099:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692353.509914:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108007168 00000100:00100000:1.0:1787692353.509929:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692353.509930:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108007168 00000100:00100000:3.0:1787692353.510048:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108007424 00000100:00100000:3.0:1787692353.510053:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108007424 00000100:00100000:2.0:1787692353.510095:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108007296 00000100:00100000:2.0:1787692353.510100:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108007296 00000100:00100000:3.0:1787692353.510114:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:2.0:1787692353.510124:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:3.0:1787692353.510125:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+6:8157:x1874531108007424:12345-192.168.206.27@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787692353.510129:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeeda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1874531108007296:12345-192.168.206.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787692353.510170:0:8080:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 749d9e33-d584-4e2f-a596-9a00b88adda5@192.168.206.27@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:2.0:1787692353.510200:0:8080:0:(genops.c:1385:class_connect()) connect: client 749d9e33-d584-4e2f-a596-9a00b88adda5, cookie 0x5d8b8560a09de3a3 00002000:00100000:2.0:1787692353.510209:0:8080:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 749d9e33-d584-4e2f-a596-9a00b88adda5/ffff92ec904dd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787692353.510245:0:8080:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000004:00200000:3.0:1787692353.510358:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787692353.510513:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+6:8157:x1874531108007424:12345-192.168.206.27@tcp:33:mount.lustre.0 Request processed in 389us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692353.510521:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00002000:00080000:2.0:1787692353.510875:0:8080:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787692353.510913:0:8080:0:(import.c:65:import_set_state_nolock()) ffff92ec904da000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787692353.510949:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeeda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+6:2360:x1874531108007296:12345-192.168.206.27@tcp:8:mount.lustre.0 Request processed in 818us (6850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692353.510956:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:2.0:1787692353.516531:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:2.0:1787692353.516543:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1874531108007168:12345-192.168.206.27@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787692353.516575:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 749d9e33-d584-4e2f-a596-9a00b88adda5@192.168.206.27@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:2.0:1787692353.516608:0:6681:0:(genops.c:1385:class_connect()) connect: client 749d9e33-d584-4e2f-a596-9a00b88adda5, cookie 0x5d8b8560a09de3aa 00002000:00100000:2.0:1787692353.516619:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 749d9e33-d584-4e2f-a596-9a00b88adda5/ffff92ec904dc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787692353.516643:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787692353.517701:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787692353.517883:0:6681:0:(import.c:65:import_set_state_nolock()) ffff92eb850d5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787692353.518251:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:749d9e33-d584-4e2f-a596-9a00b88adda5+6:2360:x1874531108007168:12345-192.168.206.27@tcp:8:mount.lustre.0 Request processed in 1704us (14261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692353.518262:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000001:00100000:1.0:1787692353.946649:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 749d9e33-d584-4e2f-a596-9a00b88adda5 00010000:00010000:2.0:1787692354.049693:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692354.369136:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125864960:0@lo:400:kworker.0 00000100:00100000:3.0:1787692354.369255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692354.369304:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125865472:0@lo:400:kworker.0 00000100:00100000:3.0:1787692354.369349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692354.369381:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692354.369387:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125865088:0@lo:400:kworker.0 00000100:00100000:3.0:1787692354.369410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692354.374362:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125864832:0@lo:400:kworker.0 00000100:00100000:2.0:1787692354.374443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692354.374505:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125865344:0@lo:400:kworker.0 00000100:00100000:2.0:1787692354.374535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692354.374562:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787692354.374568:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125865216:0@lo:400:kworker.0 00000100:00100000:2.0:1787692354.374594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692354.374632:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125865472 00000100:00100000:2.0:1787692354.374639:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125865472 00000100:00100000:2.0:1787692354.374695:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125865216 00000100:00100000:2.0:1787692354.374699:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125865216 00000100:00100000:2.0:1787692354.374723:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787692354.374748:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125865472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692354.374825:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125865472:12345-0@lo:400:kworker.0 Request processed in 65us (5460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692354.374832:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787692354.374846:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787692354.374856:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125865216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692354.374886:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125865216:12345-0@lo:400:kworker.0 Request processed in 30us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692354.374892:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787692354.374910:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125864960 00000100:00100000:2.0:1787692354.374913:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125864960 00000100:00100000:2.0:1787692354.374935:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125865088 00000100:00100000:2.0:1787692354.374938:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125865088 00000100:00100000:2.0:1787692354.374957:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125865344 00000100:00100000:2.0:1787692354.374960:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125865344 00000100:00100000:2.0:1787692354.374977:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787692354.374983:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125864960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692354.375015:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125864960:12345-0@lo:400:kworker.0 Request processed in 33us (5760us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692354.375030:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787692354.375042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787692354.375048:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125865088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692354.375078:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125865088:12345-0@lo:400:kworker.0 Request processed in 30us (5667us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692354.375083:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787692354.375093:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787692354.375099:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125865344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692354.375125:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125865344:12345-0@lo:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692354.375131:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787692354.375163:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125864832 00000100:00100000:2.0:1787692354.375167:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125864832 00000100:00100000:2.0:1787692354.375192:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1787692354.375198:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125864832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692354.375228:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125864832:12345-0@lo:400:kworker.0 Request processed in 31us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692354.375234:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:2.0:1787692354.375260:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787692354.375264:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787692354.375266:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787692354.375296:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125865088:0@lo:400:kworker.0 00000100:00100000:2.0:1787692354.375308:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125864960:0@lo:400:kworker.0 00010000:00080000:2.0:1787692354.375322:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb4f50a80 x1874531125865472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692354.375348:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125865472:0@lo:400:kworker.0 00010000:00080000:2.0:1787692354.375391:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb4f52300 x1874531125865216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692354.375399:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125865216:0@lo:400:kworker.0 00000100:00100000:2.0:1787692354.375406:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125864832:0@lo:400:kworker.0 00000100:00100000:2.0:1787692354.375414:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125865344:0@lo:400:kworker.0 00000100:00100000:3.0:1787692354.885788:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125865600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692354.885880:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692354.886066:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125865600 00000100:00100000:0.0:1787692354.886073:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125865600 00000100:00100000:0.0:1787692354.886120:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787692354.886130:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125865600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787692354.886161:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692354.886201:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125865600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692354.886214:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1787692354.886292:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf6e1180 x1874531125865600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692354.886310:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125865600:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787692355.081851:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787692355.462935:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 749d9e33-d584-4e2f-a596-9a00b88adda5 00000100:00100000:3.0:1787692355.905079:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787692355.905102:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125865728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787692355.905174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692355.905452:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125865728 00000100:00100000:1.0:1787692355.905460:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125865728 00000100:00100000:1.0:1787692355.905514:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787692355.905524:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125865728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787692355.905558:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692355.905610:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125865728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692355.905618:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787692355.905656:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeed9880 x1874531125865728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692355.905675:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125865728:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787692356.097066:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692357.122167:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692358.147884:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787692358.209124:0:10306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:2.0:1787692358.504433:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 749d9e33-d584-4e2f-a596-9a00b88adda5 00000100:00100000:3.0:1787692358.815862:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692358.815896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692358.815939:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692358.815963:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692358.815989:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108007936 00000100:00100000:3.0:1787692358.815997:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108007936 00000100:00100000:3.0:1787692358.816050:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:3.0:1787692358.816060:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108007936:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692358.816123:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108007936:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 64us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692358.816130:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:3.0:1787692358.816150:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108007552 00000100:00100000:3.0:1787692358.816154:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108007552 00000100:00100000:3.0:1787692358.816178:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 217 00000100:00100000:3.0:1787692358.816184:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108007552:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692358.816207:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108007552:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 24us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692358.816213:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 217 00000100:00100000:3.0:1787692358.816238:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108007680 00000100:00100000:3.0:1787692358.816249:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108007680 00000100:00100000:3.0:1787692358.816276:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108007808 00000100:00100000:3.0:1787692358.816279:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108007808 00000100:00100000:3.0:1787692358.816299:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:3.0:1787692358.816305:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108007680:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692358.816331:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108007680:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692358.816337:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:3.0:1787692358.816348:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 65 00000100:00100000:3.0:1787692358.816354:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108007808:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692358.816374:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108007808:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 21us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692358.816380:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 65 00000100:00080000:3.0:1787692358.816395:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787692358.816400:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787692358.818210:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692358.818279:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108008064 00000100:00100000:2.0:1787692358.818286:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108008064 00000100:00100000:2.0:1787692358.818350:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:2.0:1787692358.818359:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108008064:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692358.818418:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108008064:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 61us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692358.818425:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00080000:3.0:1787692358.819758:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787692359.169115:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692359.489510:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125865856:0@lo:400:kworker.0 00000100:00100000:1.0:1787692359.489577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692359.489699:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125865856 00000100:00100000:2.0:1787692359.489707:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125865856 00000100:00100000:2.0:1787692359.489777:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1787692359.489788:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125865856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692359.492008:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125866240:0@lo:400:kworker.0 00000100:00100000:3.0:1787692359.492013:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125865984:0@lo:400:kworker.0 00000100:00100000:1.0:1787692359.492076:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692359.492112:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787692359.492119:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125866368:0@lo:400:kworker.0 00000100:00100000:3.0:1787692359.492124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692359.492149:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125866496:0@lo:400:kworker.0 00000100:00100000:3.0:1787692359.492172:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692359.492192:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692359.492199:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125866112:0@lo:400:kworker.0 00000100:00100000:1.0:1787692359.492205:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692359.492237:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692359.492273:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125865984 00000100:00100000:3.0:1787692359.492280:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125865984 00000100:00100000:1.0:1787692359.492329:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125866240 00000100:00100000:1.0:1787692359.492333:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125866240 00000100:00100000:3.0:1787692359.492336:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125866368 00000100:00100000:3.0:1787692359.492341:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125866368 00000100:00100000:3.0:1787692359.492364:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125866112 00000100:00100000:3.0:1787692359.492367:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125866112 00000100:00100000:3.0:1787692359.492394:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787692359.492401:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125865984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692359.492454:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125865984:12345-0@lo:400:kworker.0 Request processed in 54us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692359.492454:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125865856:0@lo:400:kworker.0 00000100:00100000:2.0:1787692359.492458:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125865856:12345-0@lo:400:kworker.0 Request processed in 2669us (2877us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692359.492475:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1787692359.492534:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787692359.492550:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787692359.492557:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125866368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692359.492596:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125866368:12345-0@lo:400:kworker.0 Request processed in 41us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692359.492602:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787692359.492613:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787692359.492620:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125866112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692359.492649:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125866496 00000100:00100000:3.0:1787692359.492650:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125866112:12345-0@lo:400:kworker.0 Request processed in 31us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692359.492656:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125866496 00000100:00100000:3.0:1787692359.492660:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787692359.492689:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787692359.492745:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125866368:0@lo:400:kworker.0 00000100:00100000:3.0:1787692359.492850:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787692359.492859:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125866496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692359.492891:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125866496:12345-0@lo:400:kworker.0 Request processed in 34us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692359.492897:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1787692359.492919:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787692359.492923:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787692359.492925:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692359.493011:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125866112:0@lo:400:kworker.0 00000100:00100000:3.0:1787692359.493021:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125865984:0@lo:400:kworker.0 00010000:00080000:3.0:1787692359.493032:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec903b1500 x1874531125866496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692359.493041:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125866496:0@lo:400:kworker.0 00000100:00100000:1.0:1787692359.493656:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125866240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692359.493749:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125866240:12345-0@lo:400:kworker.0 Request processed in 1051us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692359.493757:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787692359.494158:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec903b3100 x1874531125866240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692359.494169:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125866240:0@lo:400:kworker.0 00000100:00100000:3.0:1787692360.004606:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125866624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692360.004671:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692360.004756:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125866624 00000100:00100000:3.0:1787692360.004763:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125866624 00000100:00100000:3.0:1787692360.004804:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787692360.004831:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125866624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787692360.004864:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692360.004905:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125866624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692360.004912:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787692360.004949:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeed9180 x1874531125866624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692360.004967:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125866624:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787692360.192971:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692361.025195:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787692361.025226:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125866752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787692361.025315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692361.025390:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125866752 00000100:00100000:3.0:1787692361.025399:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125866752 00000100:00100000:3.0:1787692361.025463:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787692361.025474:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125866752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787692361.025536:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692361.025590:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125866752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692361.025597:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1787692361.025621:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787692361.025656:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec903b2d80 x1874531125866752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692361.025676:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125866752:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787692361.219190:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692362.249356:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692363.265217:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692363.942377:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692363.942421:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692363.942448:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692363.942468:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692363.942496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692363.942537:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108008192 00000100:00100000:0.0:1787692363.942548:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108008192 00000100:00100000:0.0:1787692363.942617:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 219 00000100:00100000:0.0:1787692363.942630:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2363:x1874531108008192:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692363.942728:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2363:x1874531108008192:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 101us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692363.942738:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 219 00000100:00100000:0.0:1787692363.942780:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108008448 00000100:00100000:0.0:1787692363.942784:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108008448 00000100:00100000:0.0:1787692363.942846:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108008320 00000100:00100000:0.0:1787692363.942850:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108008320 00000100:00100000:0.0:1787692363.942885:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:0.0:1787692363.942894:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2363:x1874531108008448:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692363.942931:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2363:x1874531108008448:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 39us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692363.942938:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:0.0:1787692363.942951:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:0.0:1787692363.942960:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2363:x1874531108008320:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692363.942985:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2363:x1874531108008320:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 27us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692363.942992:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:0.0:1787692363.943014:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108008704 00000100:00100000:0.0:1787692363.943018:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108008704 00000100:00100000:0.0:1787692363.943059:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108008576 00000100:00100000:0.0:1787692363.943062:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108008576 00000100:00100000:0.0:1787692363.943088:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:0.0:1787692363.943098:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2363:x1874531108008704:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692363.943127:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2363:x1874531108008704:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 32us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692363.943134:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:0.0:1787692363.943145:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:0.0:1787692363.943152:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2363:x1874531108008576:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692363.943176:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2363:x1874531108008576:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 25us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692363.943182:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00080000:0.0:1787692363.943203:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787692363.943213:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787692363.943216:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787692364.289095:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692364.611797:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125867008:0@lo:400:kworker.0 00000100:00100000:0.0:1787692364.611882:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692364.611929:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125867520:0@lo:400:kworker.0 00000100:00100000:0.0:1787692364.611957:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692364.611985:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692364.611990:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125867136:0@lo:400:kworker.0 00000100:00100000:0.0:1787692364.612011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692364.612040:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125867008 00000100:00100000:0.0:1787692364.612046:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125867008 00000100:00100000:0.0:1787692364.612088:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125867136 00000100:00100000:0.0:1787692364.612092:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125867136 00000100:00100000:0.0:1787692364.612124:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787692364.612132:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125867008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692364.612179:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125867008:12345-0@lo:400:kworker.0 Request processed in 47us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692364.612187:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787692364.612204:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787692364.612211:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125867136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692364.612235:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125867136:12345-0@lo:400:kworker.0 Request processed in 26us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692364.612241:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787692364.612258:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125867520 00000100:00100000:0.0:1787692364.612261:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125867520 00000100:00100000:0.0:1787692364.612285:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787692364.612292:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaef18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125867520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692364.612336:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaef18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125867520:12345-0@lo:400:kworker.0 Request processed in 45us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692364.612342:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1787692364.612479:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787692364.612483:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692364.612512:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125867136:0@lo:400:kworker.0 00000100:00100000:0.0:1787692364.612522:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125867008:0@lo:400:kworker.0 00010000:00080000:0.0:1787692364.612531:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec88aa3100 x1874531125867520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692364.612541:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125867520:0@lo:400:kworker.0 00000100:00100000:1.0:1787692364.612726:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125866880:0@lo:400:kworker.0 00000100:00100000:1.0:1787692364.612761:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692364.612784:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125867392:0@lo:400:kworker.0 00000100:00100000:1.0:1787692364.612806:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692364.612847:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787692364.612854:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125867264:0@lo:400:kworker.0 00000100:00100000:1.0:1787692364.612876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692364.612899:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125867264 00000100:00100000:1.0:1787692364.612903:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125867264 00000100:00100000:1.0:1787692364.612933:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787692364.612939:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125867264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692364.612973:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125867264:12345-0@lo:400:kworker.0 Request processed in 34us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692364.612978:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787692364.613005:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec88aa3800 x1874531125867264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692364.613013:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125867264:0@lo:400:kworker.0 00000100:00100000:2.0:1787692364.613239:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125866880 00000100:00100000:2.0:1787692364.613244:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125866880 00000100:00100000:2.0:1787692364.613272:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787692364.613279:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125866880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692364.613316:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125866880:12345-0@lo:400:kworker.0 Request processed in 38us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692364.613322:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1787692364.613352:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125866880:0@lo:400:kworker.0 00000100:00100000:2.0:1787692364.615858:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125867392 00000100:00100000:2.0:1787692364.615873:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125867392 00000100:00080000:0.0:1787692364.615891:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787692364.615898:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692364.615938:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787692364.615949:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125867392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692364.616033:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125867392:12345-0@lo:400:kworker.0 Request processed in 87us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692364.616040:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787692364.616124:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125867392:0@lo:400:kworker.0 00000100:00100000:0.0:1787692365.121168:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125867648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787692365.121240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692365.121527:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125867648 00000100:00100000:3.0:1787692365.121534:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125867648 00000100:00100000:3.0:1787692365.121586:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787692365.121595:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125867648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787692365.121628:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692365.121763:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125867648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 169us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692365.121771:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1787692365.125035:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeed8e00 x1874531125867648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692365.125065:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125867648:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787692365.314799:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692366.145102:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787692366.145215:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125867776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692366.145425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692366.145539:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125867776 00000100:00100000:3.0:1787692366.145548:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125867776 00000100:00100000:3.0:1787692366.145643:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787692366.145654:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125867776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787692366.145687:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692366.145749:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125867776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692366.145756:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1787692366.145805:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec903b2d80 x1874531125867776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692366.145970:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125867776:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787692366.146141:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787692366.336996:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692367.362121:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692368.387736:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692369.058520:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692369.061139:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692369.061193:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692369.061222:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692369.061266:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692369.061303:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108009344 00000100:00100000:0.0:1787692369.061316:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108009344 00000100:00100000:0.0:1787692369.061406:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108009216 00000100:00100000:0.0:1787692369.061410:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108009216 00000100:00100000:0.0:1787692369.061441:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:0.0:1787692369.061466:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2364:x1874531108009344:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692369.061559:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2364:x1874531108009344:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 108us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692369.061568:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:0.0:1787692369.061588:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:0.0:1787692369.061599:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2364:x1874531108009216:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692369.061629:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2364:x1874531108009216:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 33us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692369.061635:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:0.0:1787692369.061862:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108009088 00000100:00100000:0.0:1787692369.061867:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108009088 00000100:00100000:0.0:1787692369.061900:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108008960 00000100:00100000:0.0:1787692369.061903:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108008960 00000100:00100000:0.0:1787692369.061931:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:0.0:1787692369.061939:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2364:x1874531108009088:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692369.061974:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2364:x1874531108009088:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 36us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692369.062001:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:0.0:1787692369.062024:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:0.0:1787692369.062033:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+6:2364:x1874531108008960:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692369.062062:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108008832 00000100:00100000:0.0:1787692369.062063:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+6:2364:x1874531108008960:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 33us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692369.062071:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108008832 00000100:00100000:0.0:1787692369.062072:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00080000:0.0:1787692369.062102:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787692369.062108:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787692369.062111:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787692369.062119:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 221 00000100:00100000:1.0:1787692369.062128:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2364:x1874531108008832:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692369.062178:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2364:x1874531108008832:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 51us (3674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692369.062186:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 221 00010000:00010000:0.0:1787692369.410713:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692369.735402:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787692369.735430:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125867904:0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.735522:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692369.735597:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125867904 00000100:00100000:1.0:1787692369.735605:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125867904 00000100:00100000:1.0:1787692369.735663:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787692369.735673:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125867904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.735743:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125867904:12345-0@lo:400:kworker.0 Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692369.735751:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1787692369.735845:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125867904:0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.735898:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125868032:0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.735929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692369.735968:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125868032 00000100:00100000:1.0:1787692369.735972:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125868032 00000100:00100000:1.0:1787692369.736004:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787692369.736010:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125868032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.736047:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125868032:12345-0@lo:400:kworker.0 Request processed in 37us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692369.736054:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787692369.736088:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125868032:0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.736116:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125868160:0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.736153:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692369.736177:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125868160 00000100:00100000:1.0:1787692369.736181:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125868160 00000100:00100000:1.0:1787692369.736213:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787692369.736219:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125868160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.736247:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125868160:12345-0@lo:400:kworker.0 Request processed in 28us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692369.736252:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1787692369.736268:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692369.736288:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125868160:0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.736318:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125868288:0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.736346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692369.736373:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125868288 00000100:00100000:1.0:1787692369.736376:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125868288 00000100:00100000:1.0:1787692369.736405:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787692369.736410:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125868288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.736442:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125868288:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692369.736448:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1787692369.736465:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787692369.736483:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeed8700 x1874531125868288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692369.736495:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125868288:0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.736522:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787692369.736528:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125868416:0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.736551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692369.736587:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125868416 00000100:00100000:1.0:1787692369.736591:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125868416 00000100:00100000:1.0:1787692369.736631:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787692369.736637:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeeda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125868416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.736671:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeeda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125868416:12345-0@lo:400:kworker.0 Request processed in 34us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692369.736692:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1787692369.736708:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692369.736725:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125868416:0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.736758:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125868544:0@lo:400:kworker.0 00000100:00100000:1.0:1787692369.736781:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692369.740266:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125868544 00000100:00100000:0.0:1787692369.740283:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125868544 00000100:00100000:0.0:1787692369.740385:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787692369.740398:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125868544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692369.740519:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125868544:12345-0@lo:400:kworker.0 Request processed in 124us (3735us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692369.740526:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1787692369.740558:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787692369.740602:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeed8700 x1874531125868544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692385 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692369.740619:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125868544:0@lo:400:kworker.0 00000100:00100000:3.0:1787692370.241111:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692370.241142:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125868672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692370.245379:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692370.245664:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125868672 00000100:00100000:2.0:1787692370.245686:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125868672 00000100:00100000:2.0:1787692370.245763:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787692370.245775:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125868672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787692370.245853:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692370.245946:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125868672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 173us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692370.245954:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1787692370.246024:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeed9880 x1874531125868672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692370.246049:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125868672:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787692370.437989:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692371.269266:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787692371.269289:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125868800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787692371.269436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692371.269538:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125868800 00000100:00100000:1.0:1787692371.269546:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125868800 00000100:00100000:1.0:1787692371.269609:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787692371.269620:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125868800:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787692371.269898:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1787692371.270040:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692371.270095:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125868800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 477us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692371.270103:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787692371.270165:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeed9180 x1874531125868800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692371.270193:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125868800:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787692371.458096:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692372.483407:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787692373.058317:0:11009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787692373.505087:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692374.177946:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692374.177989:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692374.178026:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692374.178073:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692374.178102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692374.178128:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108009728 00000100:00100000:1.0:1787692374.178137:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108009728 00000100:00100000:1.0:1787692374.178187:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108009600 00000100:00100000:1.0:1787692374.178190:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108009600 00000100:00100000:1.0:1787692374.178213:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:1.0:1787692374.178222:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2363:x1874531108009728:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692374.178298:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2363:x1874531108009728:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 76us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692374.178305:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:1.0:1787692374.178323:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00100000:1.0:1787692374.178330:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+6:2363:x1874531108009600:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692374.178342:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108009472 00000100:00100000:3.0:1787692374.178346:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108009472 00000100:00100000:1.0:1787692374.178354:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+6:2363:x1874531108009600:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 26us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692374.178360:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00100000:3.0:1787692374.178374:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 223 00000100:00100000:3.0:1787692374.178381:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:2363:x1874531108009472:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692374.178407:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:2363:x1874531108009472:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 26us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692374.178413:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 223 00000100:00080000:3.0:1787692374.178442:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692374.178451:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108009856 00000100:00100000:0.0:1787692374.178455:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108009856 00000100:00100000:0.0:1787692374.178499:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108009984 00000100:00100000:0.0:1787692374.178508:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108009984 00000100:00100000:0.0:1787692374.178532:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:0.0:1787692374.178541:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2360:x1874531108009856:12345-192.168.206.27@tcp:9:kworker.0 00000020:00000080:0.0:1787692374.178559:0:6679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de3aa 00000100:00080000:0.0:1787692374.178569:0:6679:0:(import.c:65:import_set_state_nolock()) ffff92eb850d5000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787692374.178594:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:3.0:1787692374.178601:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2360:x1874531108009984:12345-192.168.206.27@tcp:9:kworker.0 00000001:00000004:0.0:1787692374.178603:0:6679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000020:00000080:3.0:1787692374.178613:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de3a3 00000100:00080000:3.0:1787692374.178620:0:6681:0:(import.c:65:import_set_state_nolock()) ffff92ec904da000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787692374.178642:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787692374.178960:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+2:2360:x1874531108009856:12345-192.168.206.27@tcp:9:kworker.0 Request processed in 420us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692374.178968:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:3.0:1787692374.179506:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:749d9e33-d584-4e2f-a596-9a00b88adda5+2:2360:x1874531108009984:12345-192.168.206.27@tcp:9:kworker.0 Request processed in 897us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692374.179515:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00010000:00010000:3.0:1787692374.179535:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692374.180145:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787692374.180261:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787692374.180266:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787692374.530065:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692374.849387:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125868928:0@lo:400:kworker.0 00000100:00100000:0.0:1787692374.849450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692374.849523:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125868928 00000100:00100000:1.0:1787692374.849530:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125868928 00000100:00100000:3.0:1787692374.849672:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125869056:0@lo:400:kworker.0 00000100:00100000:3.0:1787692374.849717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692374.849891:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125869184:0@lo:400:kworker.0 00000100:00100000:2.0:1787692374.849922:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692374.850002:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125869440:0@lo:400:kworker.0 00000100:00100000:0.0:1787692374.850027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692374.850049:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787692374.850055:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125869312:0@lo:400:kworker.0 00000100:00100000:0.0:1787692374.850076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692374.850103:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125869056 00000100:00100000:0.0:1787692374.850107:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125869056 00000100:00100000:0.0:1787692374.850146:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125869184 00000100:00100000:0.0:1787692374.850149:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125869184 00000100:00100000:0.0:1787692374.850172:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125869440 00000100:00100000:0.0:1787692374.850174:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125869440 00000100:00100000:0.0:1787692374.850189:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787692374.850197:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125869056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692374.850239:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125869056:12345-0@lo:400:kworker.0 Request processed in 42us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692374.850246:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1787692374.850273:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787692374.850280:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125869184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692374.850306:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125869184:12345-0@lo:400:kworker.0 Request processed in 27us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692374.850325:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787692374.850335:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787692374.850342:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125869440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692374.850368:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125869440:12345-0@lo:400:kworker.0 Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692374.850373:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787692374.850389:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125869312 00000100:00100000:0.0:1787692374.850391:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125869312 00000100:00100000:0.0:1787692374.850414:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787692374.850421:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125869312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692374.850448:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125869312:12345-0@lo:400:kworker.0 Request processed in 28us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692374.850453:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787692374.850468:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787692374.850472:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787692374.850495:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb5330700 x1874531125869312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692374.850509:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125869312:0@lo:400:kworker.0 00000100:00100000:0.0:1787692374.850518:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125869440:0@lo:400:kworker.0 00000100:00100000:3.0:1787692374.850720:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125869056:0@lo:400:kworker.0 00000100:00100000:3.0:1787692374.850728:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125869568:0@lo:400:kworker.0 00000100:00100000:3.0:1787692374.850754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692374.851918:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125869184:0@lo:400:kworker.0 00000100:00100000:0.0:1787692374.853882:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125869568 00000100:00100000:0.0:1787692374.853895:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125869568 00000100:00100000:0.0:1787692374.853972:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787692374.853991:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125869568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692374.854073:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125869568:12345-0@lo:400:kworker.0 Request processed in 87us (3318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692374.854079:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1787692374.854103:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787692374.854492:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb5332300 x1874531125869568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692374.854507:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125869568:0@lo:400:kworker.0 00000100:00100000:1.0:1787692374.854912:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1787692374.854924:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125868928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692374.855209:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125868928:12345-0@lo:400:kworker.0 Request processed in 288us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692374.855217:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1787692374.855285:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125868928:0@lo:400:kworker.0 00000100:00100000:2.0:1787692375.362113:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125869696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787692375.362214:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692375.362395:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125869696 00000100:00100000:1.0:1787692375.362422:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125869696 00000100:00100000:1.0:1787692375.362495:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787692375.362506:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125869696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787692375.362554:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692375.362682:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125869696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692375.362690:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1787692375.366693:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb5331180 x1874531125869696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692375.366730:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125869696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787692375.554203:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787692376.008657:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 749d9e33-d584-4e2f-a596-9a00b88adda5 00000020:00000080:2.0:1787692376.008669:0:6703:0:(genops.c:885:class_export_put()) final put ffff92ec904dc800/749d9e33-d584-4e2f-a596-9a00b88adda5 00000020:00000080:2.0:1787692376.008706:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec904dc800/749d9e33-d584-4e2f-a596-9a00b88adda5 for lustre-OST0000 00000020:00000080:2.0:1787692376.008760:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92eb850d5000 for lustre-OST0000 00000100:00100000:2.0:1787692376.388119:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787692376.388148:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125869824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787692376.388242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692376.388330:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125869824 00000100:00100000:2.0:1787692376.388339:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125869824 00000100:00100000:2.0:1787692376.388434:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787692376.388446:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125869824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787692376.388493:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692376.388544:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125869824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692376.388728:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1787692376.388756:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787692376.388796:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaec75180 x1874531125869824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692376.388846:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125869824:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1787692376.473332:0:11158:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc40b1c0f0 20000000:00000080:0.0:1787692376.473354:0:11158:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92ecaf149000 uarg=0000000000000000 20000000:01000000:0.0:1787692376.473398:0:11158:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787692376.473405:0:11158:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787692376.473410:0:11158:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787692376.476188:0:11159:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787692376.476363:0:11158:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787692376.483071:0:11158:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787692376.483310:0:11158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692376.483338:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de356 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2186 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692376.483349:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de364 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de35d expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692376.483357:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de36b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692376.483363:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec813d6e00/0x5d8b8560a09de380 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de379 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692376.483371:0:11158:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de395 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21be expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692376.483379:0:11158:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692376.483444:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de395 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21be expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692376.483481:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de395 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21be expref: 12 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692376.484005:0:11158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5332a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874531125869952:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692376.484148:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec813d6e00/0x5d8b8560a09de380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de379 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692376.484158:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ec813d6e00/0x5d8b8560a09de380 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de379 expref: 18 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692376.484169:0:11158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5333100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874531125870080:0@lo:104: 00000100:00100000:1.0:1787692376.484221:0:11158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787692376.484303:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de36b expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692376.484312:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de372 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de36b expref: 18 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692376.484321:0:11158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5331880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874531125870208:0@lo:104: 00000100:00100000:1.0:1787692376.484345:0:11158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787692376.484426:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de35d expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692376.484434:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de364 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de35d expref: 18 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692376.484443:0:11158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5331180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874531125870336:0@lo:104: 00000100:00100000:1.0:1787692376.484465:0:11158:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692376.484772:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125870080 00000100:00100000:0.0:1787692376.484782:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125870080 00000100:00100000:0.0:1787692376.484886:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125870208 00000100:00100000:0.0:1787692376.484890:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125870208 00000100:00100000:0.0:1787692376.484911:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787692376.484923:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5331500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:74f850a3-c102-416a-ae3b-08438aa77de6+4:11158:x1874531125870080:12345-0@lo:104: 00010000:00010000:0.0:1787692376.484937:0:7620:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de380 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.485001:0:7620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787692376.485009:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5331500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:74f850a3-c102-416a-ae3b-08438aa77de6+4:11158:x1874531125870080:12345-0@lo:104: Request processed in 89us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692376.485017:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787692376.485037:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787692376.485055:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:74f850a3-c102-416a-ae3b-08438aa77de6+3:11158:x1874531125870208:12345-0@lo:104: 00010000:00010000:0.0:1787692376.485063:0:7620:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de372 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.485100:0:7620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787692376.485105:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5332680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:74f850a3-c102-416a-ae3b-08438aa77de6+3:11158:x1874531125870208:12345-0@lo:104: Request processed in 55us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692376.485112:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787692376.485135:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787692376.485141:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de380 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.485149:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d7600 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692376.485154:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de380 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.485164:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de380 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692376.485171:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de380 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692376.485178:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787692376.485212:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de380 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.485219:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787692376.485240:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de380 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.485258:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec813d7600/0x5d8b8560a09de379 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de380 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.485273:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692376.485276:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de372 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.485282:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425c00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692376.485285:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de372 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.485291:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de372 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692376.485298:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de372 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692376.485303:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787692376.485318:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de372 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.485324:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787692376.485342:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de372 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.485349:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92eca6425c00/0x5d8b8560a09de36b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de372 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.485359:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692376.485366:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692376.485369:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692376.485387:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787692376.485402:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125870464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787692376.485438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692376.485471:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125870592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787692376.485494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692376.485936:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125870464 00000100:00100000:0.0:1787692376.485943:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125870464 00010000:00010000:0.0:1787692376.485972:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec813d6e00/0x5d8b8560a09de380 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de379 expref: 19 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692376.485995:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125870592 00000100:00100000:0.0:1787692376.485999:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125870592 00010000:00010000:0.0:1787692376.486012:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de372 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de36b expref: 20 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692376.486031:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787692376.486039:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+20:3304:x1874531125870464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787692376.486052:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692376.486059:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec813d6e00/0x5d8b8560a09de380 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de379 expref: 20 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.486071:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec813d6e00/0x5d8b8560a09de380 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de379 expref: 20 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.486091:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692376.486125:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+20:3304:x1874531125870464:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692376.486132:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787692376.486187:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787692376.486195:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3306:x1874531125870592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787692376.486203:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692376.486208:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de372 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de36b expref: 19 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.486217:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de372 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de36b expref: 19 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.486226:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692376.486254:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3306:x1874531125870592:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692376.486261:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787692376.486311:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125870464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787692376.486337:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125870592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787692376.486751:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692376.490291:0:7620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125870336 00000100:00100000:2.0:1787692376.490309:0:7620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125870336 00010000:00010000:1.0:1787692376.490333:0:11158:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de356 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2186 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692376.490354:0:11158:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de356 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2186 expref: 12 pid: 5825 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692376.490373:0:11158:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5330380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874531125870720:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692376.490385:0:7620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787692376.490408:0:7620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:74f850a3-c102-416a-ae3b-08438aa77de6+3:11158:x1874531125870336:12345-0@lo:104: 00010000:00010000:2.0:1787692376.490424:0:7620:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de364 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692376.490492:0:11158:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90137000 going to sleep for 11 seconds 00010000:00010000:2.0:1787692376.490502:0:7620:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787692376.490509:0:7620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:74f850a3-c102-416a-ae3b-08438aa77de6+3:11158:x1874531125870336:12345-0@lo:104: Request processed in 115us (6043us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692376.490516:0:7620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787692376.490941:0:11158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec813d6e00/0x5d8b8560a09de380 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de379 expref: 18 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692376.490958:0:11158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5333100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874531125870080:0@lo:104: 00010000:00010000:1.0:1787692376.490973:0:11158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de372 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de36b expref: 17 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692376.490983:0:11158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5331880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874531125870208:0@lo:104: 00000100:00100000:1.0:1787692376.490992:0:11158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5331180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874531125870336:0@lo:104: 00010000:00010000:3.0:1787692376.491105:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692376.491114:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de364 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.491122:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35ba00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:3.0:1787692376.491127:0:8438:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de364 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.491137:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de364 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787692376.491169:0:8438:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de364 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692376.491176:0:8438:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787692376.491219:0:8438:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de364 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.491226:0:8438:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787692376.491251:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de364 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.491258:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ba00/0x5d8b8560a09de35d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de364 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.491277:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692376.491279:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692376.491281:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692376.491336:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125870848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787692376.491378:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692376.491468:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125870848 00000100:00100000:3.0:1787692376.491474:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125870848 00010000:00010000:3.0:1787692376.491770:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de364 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de35d expref: 17 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692376.491809:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787692376.491841:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5331f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+17:3307:x1874531125870848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692376.491854:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692376.491860:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de364 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de35d expref: 17 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.491871:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de364 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de35d expref: 17 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.491894:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6424600/0x5d8b8560a09de364 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de35d expref: 17 pid: 5825 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.491909:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692376.491947:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5331f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+16:3307:x1874531125870848:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692376.491954:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787692376.492068:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125870848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787692376.492422:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692376.493028:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108010112 00000100:00100000:3.0:1787692376.493038:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108010112 00010000:00010000:3.0:1787692376.493072:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de395 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21be expref: 13 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692376.493109:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:3.0:1787692376.493118:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2361:x1874531108010112:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692376.493129:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692376.493134:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de395 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21be expref: 13 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.493145:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de395 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21be expref: 13 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.493161:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692376.493209:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2361:x1874531108010112:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 93us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692376.493216:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 28 00010000:00010000:1.0:1787692376.495467:0:11158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de395 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21be expref: 12 pid: 5826 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692376.495494:0:11158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5332a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874531125869952:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692376.503004:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692376.503189:0:11158:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5330380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11158:1874531125870720:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692376.503231:0:11158:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692376.503344:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108010240 00000100:00100000:3.0:1787692376.503353:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108010240 00010000:00010000:3.0:1787692376.503399:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de356 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2186 expref: 12 pid: 5825 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692376.503451:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:3.0:1787692376.503461:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0696784b-1191-4b0f-b755-3a72c69e021b+12:2361:x1874531108010240:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692376.503481:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692376.503488:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de356 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2186 expref: 12 pid: 5825 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.503514:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de356 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2186 expref: 12 pid: 5825 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.503537:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6424e00/0x5d8b8560a09de356 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2186 expref: 12 pid: 5825 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.503557:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.503566:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.503583:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.503591:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.503598:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.503606:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.503623:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d6800 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692376.503627:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.503636:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.503666:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692376.503676:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692376.504058:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0696784b-1191-4b0f-b755-3a72c69e021b+11:2361:x1874531108010240:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 596us (1069us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692376.504068:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 29 00010000:00010000:2.0:1787692376.504178:0:11158:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692376.504188:0:11158:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692376.504194:0:11158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec813d6800/0x5d8b8560a09de3b1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11158 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692376.578356:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692377.602757:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692377.699963:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692377.702489:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108010368 00000100:00100000:1.0:1787692377.702581:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108010368 00000100:00100000:1.0:1787692377.702837:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 225 00000100:00100000:1.0:1787692377.702855:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+11:5602:x1874531108010368:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787692377.702880:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692377.702911:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de3b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b21e8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692377.702955:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de3b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21e8 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692377.702968:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de3b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21e8 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692377.702980:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec813d7800, rc 0) 00000100:00100000:1.0:1787692377.703176:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+12:5602:x1874531108010368:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 324us (3227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692377.703184:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 225 00000100:00100000:0.0:1787692377.706208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692377.707008:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108010496 00000100:00100000:1.0:1787692377.707023:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108010496 00000100:00100000:1.0:1787692377.707108:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 226 00000100:00100000:1.0:1787692377.707121:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+12:5602:x1874531108010496:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692377.713182:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+12:5602:x1874531108010496:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 6044us (6970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692377.713201:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 226 00000100:00100000:2.0:1787692377.724929:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692377.725107:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108010624 00000100:00100000:1.0:1787692377.725136:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108010624 00000100:00100000:1.0:1787692377.725207:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 227 00000100:00100000:1.0:1787692377.725220:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+12:5602:x1874531108010624:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692377.727139:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+12:5602:x1874531108010624:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 1905us (2208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692377.727156:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 227 00000100:00100000:2.0:1787692377.740231:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692377.743766:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108010752 00000100:00100000:3.0:1787692377.743787:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108010752 00000100:00100000:3.0:1787692377.743874:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 228 00000100:00100000:3.0:1787692377.743884:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+12:5602:x1874531108010752:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787692377.743905:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692377.743927:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de3bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b21ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692377.743962:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de3bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21ef expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692377.743973:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de3bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21ef expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692377.743998:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35ba00, rc 0) 00000100:00100000:3.0:1787692377.744079:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:5602:x1874531108010752:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 196us (3863us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692377.744086:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 228 00000100:00100000:3.0:1787692377.749301:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692377.754612:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108010880 00000100:00100000:0.0:1787692377.754630:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108010880 00000100:00100000:0.0:1787692377.754836:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 229 00000100:00100000:0.0:1787692377.754851:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:5602:x1874531108010880:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787692377.755206:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:5602:x1874531108010880:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 359us (5919us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692377.755215:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 229 00000100:00100000:0.0:1787692377.765489:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692377.767730:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108011008 00000100:00100000:2.0:1787692377.767749:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108011008 00000100:00100000:2.0:1787692377.767843:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 230 00000100:00100000:2.0:1787692377.767856:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:5602:x1874531108011008:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787692377.768149:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:5602:x1874531108011008:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 295us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692377.768159:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 230 10000000:01000000:1.0:1787692378.433900:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787692378.433912:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92eb85134000 from 7 10000000:01000000:1.0:1787692378.433919:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787692378.434060:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692378.434074:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692378.434088:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692378.434122:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5330380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125870976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787692378.434221:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692378.434344:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec91908240 going to sleep for 11 seconds 00000100:00100000:0.0:1787692378.435070:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125870976 00000100:00100000:0.0:1787692378.435097:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125870976 00000100:00100000:0.0:1787692378.435224:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1787692378.435240:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125870976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692378.435259:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692378.435277:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6425200/0x5d8b8560a09de3cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de3c6 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692378.435308:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6425200/0x5d8b8560a09de3cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de3c6 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692378.435321:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6425200/0x5d8b8560a09de3cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de3c6 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692378.435332:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425200, rc 0) 00000100:00100000:0.0:1787692378.435407:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125870976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692378.435415:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787692378.435518:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5330380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125870976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787692378.435538:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de3cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692378.435548:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de3cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692378.435626:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5330380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692378.435683:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692378.435787:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec91908240 going to sleep for 11 seconds 00000100:00100000:2.0:1787692378.436150:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125871104 00000100:00100000:2.0:1787692378.436156:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125871104 00000100:00100000:2.0:1787692378.436186:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787692378.436193:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125871104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692378.436525:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125871104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692378.436532:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1787692378.436573:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5330380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692378.436616:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaec74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787692378.436672:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692378.436688:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4954e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787692378.436699:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125871232 00000100:00100000:2.0:1787692378.436702:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125871232 00000100:00100000:2.0:1787692378.436719:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787692378.436724:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125871232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787692378.437260:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125871232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692378.437269:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787692378.437328:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaec74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787692378.439450:0:11214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787692378.439575:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787692378.439606:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787692378.439621:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de3cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692378.439649:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de3cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692378.439662:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787692378.439665:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ecafbbe800 from 7 10000000:01000000:2.0:1787692378.439669:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787692378.439720:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692378.439729:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692378.439742:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692378.439784:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaec74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787692378.439886:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692378.439938:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4954a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787692378.439989:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125871360 00000100:00100000:2.0:1787692378.439998:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125871360 00000100:00100000:2.0:1787692378.440048:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787692378.440058:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125871360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787692378.440073:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692378.440088:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de3db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de3d4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692378.440117:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de3db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de3d4 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692378.440130:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de3db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de3d4 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692378.440140:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2200, rc 0) 00000100:00100000:2.0:1787692378.440180:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125871360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692378.440187:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787692378.440235:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaec74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787692378.440251:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de3db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692378.440261:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de3db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692378.440316:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaec74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692378.440343:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692378.440356:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4954a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787692378.440375:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125871488 00000100:00100000:2.0:1787692378.440379:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125871488 00000100:00100000:2.0:1787692378.440397:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787692378.440402:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125871488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692378.443507:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125871488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3090us (3149us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692378.443525:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787692378.443662:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaec74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787692378.443732:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787692378.445022:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692378.445174:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecbbf49900 going to sleep for 11 seconds 00000100:00100000:1.0:1787692378.446807:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125871616 00000100:00100000:1.0:1787692378.446841:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125871616 00000100:00100000:1.0:1787692378.446937:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787692378.447232:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125871616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692378.447530:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125871616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 304us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692378.447539:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787692378.447703:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787692378.449072:0:11215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787692378.449260:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787692378.449282:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787692378.449294:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de3db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692378.449307:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de3db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692378.449318:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787692378.449321:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ec9dbcc000 from 7 10000000:01000000:1.0:1787692378.449324:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787692378.449364:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692378.449373:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692378.449386:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692378.449413:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5332a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787692378.449486:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692378.449534:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07480 going to sleep for 11 seconds 00000100:00100000:2.0:1787692378.450139:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125871744 00000100:00100000:2.0:1787692378.450150:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125871744 00000100:00100000:2.0:1787692378.450204:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787692378.450215:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125871744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787692378.450232:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692378.450248:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de3e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de3e2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692378.450276:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de3e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de3e2 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692378.450287:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de3e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de3e2 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692378.450297:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3800, rc 0) 00000100:00100000:2.0:1787692378.450345:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125871744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692378.450352:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787692378.450459:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5332a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787692378.450476:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de3e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692378.450486:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de3e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692378.450549:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5332a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692378.450576:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692378.450605:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87c07480 going to sleep for 11 seconds 00000100:00100000:2.0:1787692378.450670:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125871872 00000100:00100000:2.0:1787692378.450682:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125871872 00000100:00100000:2.0:1787692378.450711:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787692378.450717:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125871872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692378.451291:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125871872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 570us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692378.451300:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787692378.451337:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5332a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125871872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692378.451372:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaec74e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125872000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787692378.451411:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692378.451432:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4954a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787692378.451444:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125872000 00000100:00100000:2.0:1787692378.451448:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125872000 00000100:00100000:2.0:1787692378.451469:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787692378.451474:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125872000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787692378.451624:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125872000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692378.451645:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787692378.451680:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaec74e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125872000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787692378.462184:0:11216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787692378.463740:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787692378.463786:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787692378.463802:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de3e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692378.463832:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de3e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692378.626050:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787692379.026223:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 749d9e33-d584-4e2f-a596-9a00b88adda5 00000020:00000080:2.0:1787692379.026232:0:7630:0:(genops.c:885:class_export_put()) final put ffff92ec904dd800/749d9e33-d584-4e2f-a596-9a00b88adda5 00000020:00000080:0.0:1787692379.026950:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec904dd800/749d9e33-d584-4e2f-a596-9a00b88adda5 for lustre-OST0001 00000020:00000080:0.0:1787692379.027000:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ec904da000 for lustre-OST0001 00000100:00100000:1.0:1787692379.299803:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692379.299980:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692379.300013:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692379.300061:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108011136 00000100:00100000:2.0:1787692379.300071:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108011136 00000100:00100000:2.0:1787692379.300117:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 240 00000100:00100000:2.0:1787692379.300127:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2363:x1874531108011136:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692379.300210:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2363:x1874531108011136:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 84us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692379.300225:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 240 00000100:00100000:0.0:1787692379.308265:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108011264 00000100:00100000:0.0:1787692379.308280:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108011264 00000100:00100000:0.0:1787692379.308363:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108011392 00000100:00100000:0.0:1787692379.308374:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108011392 00000100:00100000:0.0:1787692379.308416:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:0.0:1787692379.308427:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2363:x1874531108011264:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692379.308506:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2363:x1874531108011264:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 81us (8712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692379.308514:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:0.0:1787692379.308532:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:0.0:1787692379.308540:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2363:x1874531108011392:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692379.308565:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2363:x1874531108011392:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 28us (8552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692379.308571:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00080000:1.0:1787692379.309758:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787692379.651670:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692379.969133:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125872128:0@lo:400:kworker.0 00000100:00100000:3.0:1787692379.969204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692379.969895:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125872128 00000100:00100000:2.0:1787692379.969904:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125872128 00000100:00100000:2.0:1787692379.969949:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787692379.969957:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125872128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692379.970877:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125872256:0@lo:400:kworker.0 00000100:00100000:1.0:1787692379.970917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692379.972889:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125872256 00000100:00100000:1.0:1787692379.972901:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125872256 00000100:00100000:1.0:1787692379.972956:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787692379.972965:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125872256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692379.973395:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125872128:12345-0@lo:400:kworker.0 Request processed in 3436us (4189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692379.973405:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787692379.974119:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125872128:0@lo:400:kworker.0 00000100:00100000:3.0:1787692379.974147:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125872640:0@lo:400:kworker.0 00000100:00100000:3.0:1787692379.974195:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692379.974260:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125872256:12345-0@lo:400:kworker.0 Request processed in 1295us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692379.974269:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787692379.974385:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787692379.974392:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125872768:0@lo:400:kworker.0 00000100:00100000:1.0:1787692379.974406:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125872640 00000100:00100000:1.0:1787692379.974413:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125872640 00000100:00100000:3.0:1787692379.974423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692379.974469:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787692379.974479:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125872640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692379.974525:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125872640:12345-0@lo:400:kworker.0 Request processed in 49us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692379.974533:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787692379.974552:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125872640:0@lo:400:kworker.0 00000100:00080000:1.0:1787692379.974555:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692379.974577:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125872256:0@lo:400:kworker.0 00000100:00100000:3.0:1787692379.975020:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125872512:0@lo:400:kworker.0 00000100:00100000:3.0:1787692379.975058:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692379.975090:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787692379.975097:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125872384:0@lo:400:kworker.0 00000100:00100000:3.0:1787692379.975121:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692379.975481:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125872768 00000100:00100000:1.0:1787692379.975487:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125872768 00000100:00100000:1.0:1787692379.975542:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125872512 00000100:00100000:1.0:1787692379.975545:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125872512 00000100:00100000:1.0:1787692379.975572:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787692379.975579:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125872768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692379.975633:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125872768:12345-0@lo:400:kworker.0 Request processed in 44us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692379.975639:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787692379.975653:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787692379.975660:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125872512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692379.975694:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125872512:12345-0@lo:400:kworker.0 Request processed in 35us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692379.975700:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787692379.975735:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecae9fea00 x1874531125872512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692379.975746:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125872512:0@lo:400:kworker.0 00010000:00080000:1.0:1787692379.975772:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecae9fd180 x1874531125872768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692379.975793:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125872768:0@lo:400:kworker.0 00000100:00100000:1.0:1787692379.975856:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125872384 00000100:00100000:1.0:1787692379.975860:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125872384 00000100:00100000:1.0:1787692379.975886:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787692379.975893:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125872384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692379.975925:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125872384:12345-0@lo:400:kworker.0 Request processed in 33us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692379.975929:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787692379.975957:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125872384:0@lo:400:kworker.0 00000100:00080000:2.0:1787692379.976015:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787692379.976019:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787692379.976021:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:0.0:1787692380.418396:0:11357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1787692380.481052:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125872896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692380.481126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692380.481288:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125872896 00000100:00100000:0.0:1787692380.481295:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125872896 00000100:00100000:0.0:1787692380.481348:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787692380.481359:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125872896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787692380.481389:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692380.481433:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125872896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692380.481440:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1787692380.481514:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecae9fdf80 x1874531125872896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692380.481534:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125872896:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787692380.673575:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692381.505070:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692381.505094:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaec74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125873024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787692381.505176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692381.505310:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125873024 00000100:00100000:0.0:1787692381.505320:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125873024 00000100:00100000:0.0:1787692381.505389:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787692381.505409:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125873024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787692381.505443:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692381.505508:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125873024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692381.505515:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787692381.505555:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaec74e00 x1874531125873024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692381.505572:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaec74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125873024:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787692381.505650:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787692381.697089:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692382.720966:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692383.747767:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787692383.807945:0:11456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 17:13:02 (1787692382) === 00000100:00100000:0.0:1787692384.041089:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692384.041152:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108011520 00000100:00100000:3.0:1787692384.041163:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108011520 00000100:00100000:3.0:1787692384.041282:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:3.0:1787692384.041292:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+6:2363:x1874531108011520:12345-192.168.206.27@tcp:41:mkdir.0 00000004:00000024:3.0:1787692384.041334:0:8461:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787692384.041410:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+6:2363:x1874531108011520:12345-192.168.206.27@tcp:41:mkdir.0 Request processed in 119us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692384.041417:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:3.0:1787692384.041505:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00080000:0.0:1787692384.041702:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692384.042628:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108011648 00000100:00100000:1.0:1787692384.042637:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108011648 00000100:00100000:1.0:1787692384.042678:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:1.0:1787692384.042686:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:067f46f5-4779-40e6-b53d-5b3e89751501+6:9709:x1874531108011648:12345-192.168.206.27@tcp:700:mkdir.0 00000100:00100000:1.0:1787692384.042898:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:067f46f5-4779-40e6-b53d-5b3e89751501+6:9709:x1874531108011648:12345-192.168.206.27@tcp:700:mkdir.0 Request processed in 213us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692384.042905:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:2.0:1787692384.051303:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692384.051432:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108011904 00000100:00100000:0.0:1787692384.051444:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108011904 00000100:00100000:0.0:1787692384.051515:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:0.0:1787692384.051527:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:9709:x1874531108011904:12345-192.168.206.27@tcp:36:mkdir.0 00010000:00010000:0.0:1787692384.051596:0:8193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692384.051633:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de2d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2171 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.051654:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:0.0:1787692384.051719:0:8193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787692384.052083:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de3f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.052098:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de3f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.052108:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de3f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.053434:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de3f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.053464:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.053475:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692384.059459:0:8193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787692384.059477:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de3f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.059487:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de3f0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.059496:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de3f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.059513:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692384.059519:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de3f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.059527:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de3f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.059546:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec832f4500) 00010000:00010000:1.0:1787692384.059549:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692384.059553:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de3f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.059559:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de3f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787692384.059594:0:8193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042ac587b reply state 00000000b9b3fc8c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692384.059614:0:8193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787692384.059718:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:9709:x1874531108011904:12345-192.168.206.27@tcp:36:mkdir.0 Request processed in 8189us (8419us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787692384.059727:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00010000:00010000:3.0:1787692384.063328:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de3f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.063346:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de3f7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.063371:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de3f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.063378:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692384.063383:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de3f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.063391:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de3f7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.063407:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92ec832f4f00) 00010000:00010000:3.0:1787692384.063411:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692384.063416:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de3f7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.063422:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de3f7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692384.073319:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692384.073393:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108012032 00000100:00100000:0.0:1787692384.073403:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108012032 00000100:00100000:0.0:1787692384.073471:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:0.0:1787692384.073483:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:9710:x1874531108012032:12345-192.168.206.27@tcp:101:chmod.0 00010000:00010000:0.0:1787692384.073504:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692384.073528:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de3fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b21f6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.073612:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425800/0x5d8b8560a09de405 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.073626:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425800/0x5d8b8560a09de405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.073638:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425800/0x5d8b8560a09de405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692384.073708:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787692384.073713:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692384.073754:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425800/0x5d8b8560a09de405 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.073781:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de3fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21f6 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.073845:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425800/0x5d8b8560a09de405 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21f6 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.073854:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec832f4300) 00010000:00010000:0.0:1787692384.073857:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787692384.073861:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425800, rc 0) 00000100:00100000:0.0:1787692384.073919:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:9710:x1874531108012032:12345-192.168.206.27@tcp:101:chmod.0 Request processed in 439us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692384.073927:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:2.0:1787692384.076337:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692384.076406:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108012288 00000100:00100000:3.0:1787692384.076415:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108012288 00000100:00100000:3.0:1787692384.076466:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:3.0:1787692384.076476:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:9710:x1874531108012288:12345-192.168.206.27@tcp:36:chmod.0 00010000:00010000:3.0:1787692384.076522:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692384.076546:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425800/0x5d8b8560a09de405 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21f6 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.076575:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec832f4300) 00010000:00010000:3.0:1787692384.076597:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787692384.076631:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de40c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.076642:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de40c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.076651:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de40c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787692384.076962:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ce75fa00 reply state 00000000fabbc55b transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de40c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692384.076971:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787692384.076983:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787692384.077059:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+8:9710:x1874531108012288:12345-192.168.206.27@tcp:36:chmod.0 Request processed in 583us (730us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787692384.077066:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 00010000:00010000:1.0:1787692384.083406:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de40c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.083421:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de40c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.083428:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de40c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.083450:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692384.083455:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de40c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.083462:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de40c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.083477:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a900) 00010000:00010000:1.0:1787692384.083480:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787692384.083484:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de40c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.083490:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de40c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692384.107094:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692384.107541:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108012416 00000100:00100000:1.0:1787692384.107552:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108012416 00000100:00100000:1.0:1787692384.107734:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:1.0:1787692384.107745:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:9711:x1874531108012416:12345-192.168.206.27@tcp:101:chown.0 00010000:00010000:1.0:1787692384.107768:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692384.107791:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec813d6800/0x5d8b8560a09de413 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b21fd expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.107877:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec813d6e00/0x5d8b8560a09de41a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.107891:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec813d6e00/0x5d8b8560a09de41a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.107901:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec813d6e00/0x5d8b8560a09de41a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692384.107968:0:8193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787692384.107972:0:8193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692384.108012:0:8193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec813d6e00/0x5d8b8560a09de41a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.108038:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec813d6800/0x5d8b8560a09de413 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21fd expref: 9 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.108056:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec813d6e00/0x5d8b8560a09de41a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21fd expref: 8 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.108064:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9dbfa700) 00010000:00010000:1.0:1787692384.108067:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787692384.108070:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec813d6e00, rc 0) 00000100:00100000:1.0:1787692384.108136:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+8:9711:x1874531108012416:12345-192.168.206.27@tcp:101:chown.0 Request processed in 393us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692384.108144:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:2.0:1787692384.111459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692384.113929:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108012544 00000100:00100000:3.0:1787692384.113945:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108012544 00000100:00100000:2.0:1787692384.114082:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:2.0:1787692384.114095:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+8:9711:x1874531108012544:12345-192.168.206.27@tcp:101:chown.0 00010000:00010000:2.0:1787692384.114114:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692384.114144:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de421 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2204 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114214:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de428 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114243:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de428 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114256:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de428 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114272:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de42f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114280:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de42f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114286:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de42f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114385:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de436 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114693:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114703:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692384.114745:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787692384.114749:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692384.114773:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114786:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de428 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114804:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de428 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114810:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de428 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114835:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692384.114839:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de428 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114846:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de428 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114858:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9dbfa700) 00010000:00010000:2.0:1787692384.114861:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692384.114865:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de428 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114870:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de428 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114884:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de42f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114891:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de42f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114896:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de42f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114901:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692384.114910:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de42f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114916:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de42f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114925:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92ec94636700) 00010000:00010000:2.0:1787692384.114927:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692384.114930:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de42f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114936:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de42f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114971:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de421 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2204 expref: 10 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114985:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2204 expref: 9 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.114993:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ec94636c00) 00010000:00010000:2.0:1787692384.114996:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787692384.114999:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3600, rc 0) 00000100:00100000:2.0:1787692384.115072:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+9:9711:x1874531108012544:12345-192.168.206.27@tcp:101:chown.0 Request processed in 980us (3623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692384.115081:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:3.0:1787692384.118305:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692384.118381:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108012800 00000100:00100000:2.0:1787692384.118390:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108012800 00000100:00100000:2.0:1787692384.118450:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:2.0:1787692384.118460:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+9:9711:x1874531108012800:12345-192.168.206.27@tcp:36:chown.0 00010000:00010000:2.0:1787692384.118521:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692384.118545:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de436 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2204 expref: 9 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.118563:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ec94636c00) 00010000:00010000:2.0:1787692384.118574:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787692384.118611:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de43d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.118624:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de43d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.118632:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de43d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787692384.170862:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1787692384.170877:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1787692384.170958:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c73f0e48 reply state 00000000601996c2 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de43d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692384.170970:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787692384.171128:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1787692384.171222:0:5833:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1787692384.171242:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+7:9711:x1874531108012800:12345-192.168.206.27@tcp:36:chown.0 Request processed in 52780us (52943us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787692384.171251:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00010000:00010000:1.0:1787692384.171324:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de43d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.171333:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de43d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.171340:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de43d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.171345:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692384.171357:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de43d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.171365:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de43d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.171381:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ec94636300) 00010000:00010000:1.0:1787692384.171384:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787692384.171388:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de43d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.171394:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de43d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692384.189998:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692384.191983:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108012928 00000100:00100000:0.0:1787692384.191997:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108012928 00000100:00100000:2.0:1787692384.193002:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:2.0:1787692384.193015:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:9712:x1874531108012928:12345-192.168.206.27@tcp:101:touch.500 00010000:00010000:2.0:1787692384.193048:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692384.193068:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de444 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b220b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787692384.195210:0:5832:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2097us 00010000:00010000:0.0:1787692384.213719:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424000/0x5d8b8560a09de44b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.213744:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424000/0x5d8b8560a09de44b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.213755:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424000/0x5d8b8560a09de44b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.213770:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de452 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.213777:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de452 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.213784:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de452 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214276:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de459 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214286:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214294:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692384.214376:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787692384.214380:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692384.214470:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de459 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214483:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424000/0x5d8b8560a09de44b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214489:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424000/0x5d8b8560a09de44b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214503:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424000/0x5d8b8560a09de44b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214510:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692384.214514:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424000/0x5d8b8560a09de44b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214521:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424000/0x5d8b8560a09de44b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214534:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9dbfa700) 00010000:00010000:0.0:1787692384.214541:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692384.214546:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424000/0x5d8b8560a09de44b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214552:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424000/0x5d8b8560a09de44b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214564:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de452 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214644:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de452 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214650:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de452 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214655:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692384.214657:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de452 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214664:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de452 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214672:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692384.214674:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692384.214677:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de452 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214683:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de452 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214722:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de444 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b220b expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214751:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de459 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b220b expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.214758:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ec832f4200) 00010000:00010000:0.0:1787692384.214761:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787692384.214763:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6424e00, rc 0) 00000100:00100000:0.0:1787692384.214863:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:9712:x1874531108012928:12345-192.168.206.27@tcp:101:touch.500 Request processed in 21849us (24872us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692384.214871:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:0.0:1787692384.219906:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692384.219991:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108013184 00000100:00100000:2.0:1787692384.220001:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108013184 00000100:00100000:2.0:1787692384.220056:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:2.0:1787692384.220065:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+7:9712:x1874531108013184:12345-192.168.206.27@tcp:101:touch.500 00010000:00010000:2.0:1787692384.220084:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692384.220339:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de460 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2212 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.221271:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de467 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.221288:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de467 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.221299:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de467 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.221313:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de46e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.221320:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.221325:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787692384.222158:0:8461:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1787692384.222414:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.222425:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.222434:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.222468:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de467 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.222485:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de467 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.222491:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de467 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.222496:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692384.222500:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de467 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.222506:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de467 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.222517:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ec832f4200) 00010000:00010000:2.0:1787692384.222520:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692384.222525:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de467 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.222530:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de467 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787692384.222543:0:8461:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ed2d181 reply state 000000000ea67400 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692384.222551:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787692384.222585:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de460 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2212 expref: 10 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.222614:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2212 expref: 9 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.222634:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ec94636900) 00010000:00010000:2.0:1787692384.222636:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692384.222638:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3600, rc 0) 00000100:00100000:2.0:1787692384.222724:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+10:9712:x1874531108013184:12345-192.168.206.27@tcp:101:touch.500 Request processed in 2659us (2831us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787692384.222733:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 22 00010000:00010000:1.0:1787692384.227295:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.227313:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de46e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.227321:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de46e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.227326:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692384.227331:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de46e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.227338:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de46e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.227354:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd82be10b (ffff92ec94636c00) 00010000:00010000:1.0:1787692384.227358:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692384.227375:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de46e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.227381:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de46e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692384.229581:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692384.229664:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108013440 00000100:00100000:3.0:1787692384.229673:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108013440 00000100:00100000:3.0:1787692384.229735:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:3.0:1787692384.229745:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+9:9712:x1874531108013440:12345-192.168.206.27@tcp:36:touch.500 00010000:00010000:3.0:1787692384.229796:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692384.229851:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de475 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2212 expref: 9 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.229869:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ec94636900) 00010000:00010000:3.0:1787692384.229881:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787692384.229920:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de483 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.229932:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.229941:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787692384.230065:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026fb1070 reply state 00000000858c3a57 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692384.230074:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787692384.230155:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+10:9712:x1874531108013440:12345-192.168.206.27@tcp:36:touch.500 Request processed in 412us (588us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787692384.230162:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 23 00010000:00010000:1.0:1787692384.232429:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.232449:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de483 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.232456:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.232462:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692384.232467:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.232486:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de483 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.232505:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ec9459a200) 00010000:00010000:1.0:1787692384.232509:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692384.232513:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de483 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.232519:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de483 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692384.233423:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692384.233522:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108013568 00000100:00100000:2.0:1787692384.233531:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108013568 00000100:00100000:2.0:1787692384.233590:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:2.0:1787692384.233611:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+9:9712:x1874531108013568:12345-192.168.206.27@tcp:101:touch.500 00010000:00010000:2.0:1787692384.233635:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692384.233654:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de48a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2219 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.233719:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de48a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2219 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.233732:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de48a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2219 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.233751:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ec94636700) 00010000:00010000:2.0:1787692384.233754:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787692384.233757:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2400, rc 0) 00000100:00100000:2.0:1787692384.233841:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+10:9712:x1874531108013568:12345-192.168.206.27@tcp:101:touch.500 Request processed in 243us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692384.233861:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:3.0:1787692384.237207:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692384.237387:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108013696 00000100:00100000:1.0:1787692384.237398:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108013696 00000100:00100000:1.0:1787692384.237442:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:1.0:1787692384.237463:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1874531108013696:12345-192.168.206.27@tcp:8:touch.500 00010000:00080000:1.0:1787692384.237492:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:1.0:1787692384.237520:0:6680:0:(genops.c:1385:class_connect()) connect: client 067f46f5-4779-40e6-b53d-5b3e89751501, cookie 0x5d8b8560a09de491 00002000:00100000:1.0:1787692384.237531:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 067f46f5-4779-40e6-b53d-5b3e89751501/ffff92ec8780a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787692384.237552:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787692384.237786:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787692384.237835:0:6680:0:(import.c:65:import_set_state_nolock()) ffff92ec8780c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787692384.237895:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:2360:x1874531108013696:12345-192.168.206.27@tcp:8:touch.500 Request processed in 432us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692384.237903:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:0.0:1787692384.247195:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692384.247262:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108013824 00000100:00100000:1.0:1787692384.247272:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108013824 00000100:00100000:1.0:1787692384.247352:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:1.0:1787692384.247371:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:0:x1874531108013824:12345-192.168.206.27@tcp:2:touch.500 00000100:00080000:0.0:1787692384.247929:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787692384.285477:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:0:x1874531108013824:12345-192.168.206.27@tcp:2:touch.500 Request processed in 38097us (38279us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787692384.285491:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 00000001:00080000:2.0:1787692384.285786:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1787692384.285796:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 067f46f5-4779-40e6-b53d-5b3e89751501 00000100:00100000:0.0:1787692384.288140:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692384.288317:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108014080 00000100:00100000:1.0:1787692384.288327:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108014080 00000100:00100000:1.0:1787692384.288381:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:1.0:1787692384.288391:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+10:9712:x1874531108014080:12345-192.168.206.27@tcp:35:touch.500 00000100:00100000:1.0:1787692384.289086:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+11:9712:x1874531108014080:12345-192.168.206.27@tcp:35:touch.500 Request processed in 692us (952us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787692384.289095:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:3.0:1787692384.304246:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692384.304415:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108014208 00000100:00100000:2.0:1787692384.304425:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108014208 00000100:00100000:2.0:1787692384.304487:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:2.0:1787692384.304497:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+11:9713:x1874531108014208:12345-192.168.206.27@tcp:101:rm.0 00010000:00010000:2.0:1787692384.304531:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692384.304552:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2220 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.304637:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de49f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.304650:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.304662:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692384.304718:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787692384.304722:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692384.304762:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de49f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.304835:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2220 expref: 13 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.304852:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de49f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2220 expref: 12 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.304873:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ec832f4200) 00010000:00010000:2.0:1787692384.304876:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787692384.304880:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3200, rc 0) 00000100:00100000:2.0:1787692384.304941:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+12:9713:x1874531108014208:12345-192.168.206.27@tcp:101:rm.0 Request processed in 445us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692384.304948:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:0.0:1787692384.309019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692384.309164:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108014464 00000100:00100000:1.0:1787692384.309183:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108014464 00000100:00100000:1.0:1787692384.309270:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:1.0:1787692384.309280:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+12:9713:x1874531108014464:12345-192.168.206.27@tcp:101:rm.0 00010000:00010000:1.0:1787692384.309298:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692384.309316:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec813d6800/0x5d8b8560a09de4a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2227 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692384.309437:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787692384.309879:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec813d6800/0x5d8b8560a09de4a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2227 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.309893:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9dbfa700) 00010000:00010000:1.0:1787692384.309896:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787692384.309901:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec813d6800/0x5d8b8560a09de4a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2227 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.309915:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec813d6800, rc 0) 00000100:00100000:1.0:1787692384.309978:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+13:9713:x1874531108014464:12345-192.168.206.27@tcp:101:rm.0 Request processed in 700us (968us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1787692384.309986:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:0.0:1787692384.314047:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692384.314135:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108014592 00000100:00100000:3.0:1787692384.314144:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108014592 00000100:00100000:3.0:1787692384.314218:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:3.0:1787692384.314228:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+13:9713:x1874531108014592:12345-192.168.206.27@tcp:37:rm.0 00000100:00100000:0.0:1787692384.319310:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+13:9713:x1874531108014592:12345-192.168.206.27@tcp:37:rm.0 Request processed in 5073us (5261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692384.319326:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:0.0:1787692384.322502:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692384.322593:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108014848 00000100:00100000:1.0:1787692384.322611:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108014848 00000100:00100000:1.0:1787692384.322666:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:1.0:1787692384.322675:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83557c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+13:9713:x1874531108014848:12345-192.168.206.27@tcp:35:rm.0 00000100:00100000:1.0:1787692384.322944:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83557c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+14:9713:x1874531108014848:12345-192.168.206.27@tcp:35:rm.0 Request processed in 269us (453us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787692384.322968:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:1.0:1787692384.326071:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692384.326252:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108015104 00000100:00100000:2.0:1787692384.326261:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108015104 00000100:00100000:2.0:1787692384.326341:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:2.0:1787692384.326351:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+14:9713:x1874531108015104:12345-192.168.206.27@tcp:101:rm.0 00010000:00010000:2.0:1787692384.326372:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692384.326401:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de4b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b222e expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.326516:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de4bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.326531:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de4bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.326541:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de4bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692384.326562:0:8193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787692384.326734:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de4b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b222e expref: 17 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.326764:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de4bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b222e expref: 16 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.326771:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ec832f4200) 00010000:00010000:2.0:1787692384.326774:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787692384.326777:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2800, rc 0) 00000100:00100000:2.0:1787692384.326869:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+16:9713:x1874531108015104:12345-192.168.206.27@tcp:101:rm.0 Request processed in 519us (807us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787692384.326877:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:3.0:1787692384.329591:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692384.329742:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108015232 00000100:00100000:2.0:1787692384.329751:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108015232 00000100:00100000:2.0:1787692384.329807:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:2.0:1787692384.329845:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+16:9713:x1874531108015232:12345-192.168.206.27@tcp:41:rm.0 00000004:00000024:2.0:1787692384.329903:0:5833:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787692384.329969:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+16:9713:x1874531108015232:12345-192.168.206.27@tcp:41:rm.0 Request processed in 127us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692384.329975:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:0.0:1787692384.334793:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692384.335234:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108015360 00000100:00100000:1.0:1787692384.335244:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108015360 00000100:00100000:1.0:1787692384.335337:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:1.0:1787692384.335348:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+16:9713:x1874531108015360:12345-192.168.206.27@tcp:101:rm.0 00010000:00010000:1.0:1787692384.335368:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692384.335392:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec813d7600/0x5d8b8560a09de4c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2235 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335476:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de4d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335490:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de4d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335501:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de4d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335518:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de4d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335526:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335533:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335666:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de4de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335682:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335690:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692384.335717:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787692384.335721:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692384.335738:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335748:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de4de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335756:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de4d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335762:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de4d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335768:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de4d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335775:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692384.335779:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de4d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335786:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de4d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335798:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ec832f4200) 00010000:00010000:1.0:1787692384.335801:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692384.335868:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de4d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335876:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de4d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335889:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de4d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335895:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de4d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335901:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335906:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692384.335910:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de4d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335916:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de4d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335924:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd82be10b (ffff92ec9dbfaa00) 00010000:00010000:1.0:1787692384.335926:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692384.335928:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de4d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335933:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de4d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.335961:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec813d7600/0x5d8b8560a09de4c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2235 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.336001:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de4de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2235 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.336009:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ec94636700) 00010000:00010000:1.0:1787692384.336011:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787692384.336014:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165e00, rc 0) 00000100:00100000:1.0:1787692384.336080:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+17:9713:x1874531108015360:12345-192.168.206.27@tcp:101:rm.0 Request processed in 735us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692384.336088:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:1.0:1787692384.340026:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692384.340161:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108015616 00000100:00100000:2.0:1787692384.340170:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108015616 00000100:00100000:2.0:1787692384.340227:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 30 00000100:00100000:2.0:1787692384.340238:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+17:9713:x1874531108015616:12345-192.168.206.27@tcp:36:rm.0 00010000:00010000:2.0:1787692384.340299:0:8193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787692384.340324:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de4de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2235 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.340364:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de48a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2219 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.340375:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ec94636700) 00010000:00010000:2.0:1787692384.340390:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de49f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2220 expref: 15 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692384.340398:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ec832f4200) 00010000:00010000:2.0:1787692384.340402:0:8193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787692384.340743:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b800/0x5d8b8560a09de4e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.340758:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b800/0x5d8b8560a09de4e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.340769:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b800/0x5d8b8560a09de4e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.340786:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de4ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.340793:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de4ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.340800:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de4ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.340969:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35bc00/0x5d8b8560a09de4f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.340976:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35bc00/0x5d8b8560a09de4f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.340984:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35bc00/0x5d8b8560a09de4f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787692384.342788:0:8193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1787692384.342805:0:8193:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 290548991193ns, next at 291548987692ns, rc = 0 00010000:00010000:3.0:1787692384.343080:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de4fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343093:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de4fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343103:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de4fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343110:0:8193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de4fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343116:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de4fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343122:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de4fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343250:0:8193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692384.343283:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35bc00/0x5d8b8560a09de4f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343290:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35bc00/0x5d8b8560a09de4f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343295:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35bc00/0x5d8b8560a09de4f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343301:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35bc00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692384.343305:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35bc00/0x5d8b8560a09de4f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343312:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35bc00/0x5d8b8560a09de4f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343330:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ec9459a300) 00010000:00010000:3.0:1787692384.343333:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787692384.343337:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35bc00/0x5d8b8560a09de4f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343343:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35bc00/0x5d8b8560a09de4f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343359:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b800/0x5d8b8560a09de4e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343365:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b800/0x5d8b8560a09de4e5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343370:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b800/0x5d8b8560a09de4e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343376:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692384.343379:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b800/0x5d8b8560a09de4e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343384:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b800/0x5d8b8560a09de4e5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343391:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ec832f4200) 00010000:00010000:3.0:1787692384.343393:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692384.343396:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b800/0x5d8b8560a09de4e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692384.343402:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b800/0x5d8b8560a09de4e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787692384.343422:0:8193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042e7df3a reply state 00000000190d0aac transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de4ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692384.343430:0:8193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787692384.343564:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+16:9713:x1874531108015616:12345-192.168.206.27@tcp:36:rm.0 Request processed in 3316us (3535us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787692384.343650:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 30 00010000:00010000:0.0:1787692384.343837:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692384.343844:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de4fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.343860:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a800 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692384.343864:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de4fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.343869:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de4fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.343877:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff92ec9459a300) 00010000:00010000:0.0:1787692384.343880:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787692384.343883:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de4fa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.343888:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de4fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.343902:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692384.343904:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692384.343906:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692384.347525:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de4ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.347541:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de4ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.347549:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de4ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.347561:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35ae00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692384.347567:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de4ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.347574:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de4ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.347590:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd82be10b (ffff92ec9459ac00) 00010000:00010000:1.0:1787692384.347593:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692384.347622:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de4ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692384.347629:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de4ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd82be10b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692384.348257:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692384.348352:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108015872 00000100:00100000:2.0:1787692384.348362:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108015872 00000100:00100000:2.0:1787692384.348448:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:2.0:1787692384.348459:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+15:9713:x1874531108015872:12345-192.168.206.27@tcp:35:rm.0 00000100:00100000:2.0:1787692384.348881:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+16:9713:x1874531108015872:12345-192.168.206.27@tcp:35:rm.0 Request processed in 422us (629us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787692384.348890:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:2.0:1787692384.351455:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692384.351618:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108016128 00000100:00100000:0.0:1787692384.351627:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108016128 00000100:00100000:0.0:1787692384.351699:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:0.0:1787692384.351710:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+16:9713:x1874531108016128:12345-192.168.206.27@tcp:36:rm.0 00010000:00010000:0.0:1787692384.351763:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787692384.351788:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de4bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b222e expref: 16 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.351809:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de459 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b220b expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.351880:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ec832f4200) 00010000:00010000:0.0:1787692384.351897:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec813d6e00/0x5d8b8560a09de41a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21fd expref: 14 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.351907:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9dbfa700) 00010000:00010000:0.0:1787692384.351915:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787692384.351938:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de501 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.351950:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de501 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.351960:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de501 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.351973:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de508 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.352195:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de508 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.352206:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de508 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.352494:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de50f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.352504:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de50f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.352521:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de50f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692384.354403:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787692384.354425:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de50f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.354434:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de50f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.354441:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de50f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.354446:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692384.354452:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de50f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.354459:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de50f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.354472:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff92ec832f4100) 00010000:00010000:0.0:1787692384.354476:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787692384.354480:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de50f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.354486:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de50f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.354510:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de501 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.354516:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de501 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.354530:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de501 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.354535:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692384.354538:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de501 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.354544:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de501 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.354553:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:0.0:1787692384.354555:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692384.354559:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de501 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.354565:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de501 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787692384.354577:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cac63f7 reply state 0000000002ca7841 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de508 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692384.354586:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787692384.356864:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+15:9713:x1874531108016128:12345-192.168.206.27@tcp:36:rm.0 Request processed in 5147us (5406us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787692384.356876:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 31 00010000:00010000:0.0:1787692384.369705:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de508 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.369723:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de508 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.369749:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de508 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.369756:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692384.369761:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de508 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.369768:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de508 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.369784:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692384.369788:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692384.369793:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de508 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692384.369800:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de508 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692384.417039:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692384.417139:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692384.417274:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108016256 00000100:00100000:3.0:1787692384.417286:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108016256 00000100:00100000:3.0:1787692384.417343:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 242 00000100:00100000:3.0:1787692384.417353:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108016256:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692384.417444:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108016256:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 92us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692384.417452:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 242 00000100:00100000:1.0:1787692384.419189:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108016384 00000100:00100000:1.0:1787692384.419200:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108016384 00000100:00100000:1.0:1787692384.419285:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 89 00000100:00100000:1.0:1787692384.419295:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108016384:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692384.419367:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108016384:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 74us (2338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692384.419375:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 89 00000100:00080000:0.0:1787692384.420999:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787692384.769036:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692385.091659:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125873152:0@lo:400:kworker.0 00000100:00100000:1.0:1787692385.091733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692385.091801:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125873280:0@lo:400:kworker.0 00000100:00100000:3.0:1787692385.091854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692385.091945:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125873152 00000100:00100000:2.0:1787692385.091953:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125873152 00000100:00100000:1.0:1787692385.092193:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125873664:0@lo:400:kworker.0 00000100:00100000:1.0:1787692385.092222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692385.092313:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125873280 00000100:00100000:0.0:1787692385.092318:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125873280 00000100:00100000:0.0:1787692385.092363:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125873664 00000100:00100000:0.0:1787692385.092366:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125873664 00000100:00100000:0.0:1787692385.092400:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787692385.092410:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125873280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692385.092458:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125873280:12345-0@lo:400:kworker.0 Request processed in 51us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692385.092464:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787692385.092480:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787692385.092498:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125873664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692385.092532:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125873664:12345-0@lo:400:kworker.0 Request processed in 38us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692385.092538:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1787692385.092554:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692385.092606:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125873664:0@lo:400:kworker.0 00000100:00100000:0.0:1787692385.092924:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125873536:0@lo:400:kworker.0 00000100:00100000:0.0:1787692385.092957:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692385.092980:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787692385.092985:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125873408:0@lo:400:kworker.0 00000100:00100000:0.0:1787692385.093003:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692385.093028:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125873536 00000100:00100000:0.0:1787692385.093032:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125873536 00000100:00100000:0.0:1787692385.093064:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787692385.093070:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125873536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692385.093102:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125873536:12345-0@lo:400:kworker.0 Request processed in 34us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692385.093107:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1787692385.093120:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787692385.093136:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf1c5f80 x1874531125873536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692385.093146:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125873536:0@lo:400:kworker.0 00000100:00100000:1.0:1787692385.093210:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125873408 00000100:00100000:1.0:1787692385.093215:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125873408 00000100:00100000:1.0:1787692385.093254:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787692385.093261:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125873408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692385.093294:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125873408:12345-0@lo:400:kworker.0 Request processed in 34us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692385.093301:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1787692385.093349:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692385.093370:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125873408:0@lo:400:kworker.0 00000100:00100000:3.0:1787692385.093793:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125873280:0@lo:400:kworker.0 00000100:00100000:3.0:1787692385.093801:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125873792:0@lo:400:kworker.0 00000100:00100000:3.0:1787692385.093947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692385.094097:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787692385.094107:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125873152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692385.094148:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125873152:12345-0@lo:400:kworker.0 Request processed in 45us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692385.094168:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787692385.097001:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125873792 00000100:00100000:0.0:1787692385.097030:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125873792 00000100:00100000:0.0:1787692385.097097:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787692385.097117:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125873792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692385.097205:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125873792:12345-0@lo:400:kworker.0 Request processed in 100us (3257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692385.097213:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787692385.097242:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787692385.097282:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125873152:0@lo:400:kworker.0 00010000:00080000:3.0:1787692385.097631:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf1c5c00 x1874531125873792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692385.097644:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125873792:0@lo:400:kworker.0 00000004:00080000:0.0:1787692385.602083:0:8079:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 291808267112ns, next at 292808264887ns, rc = 0 00000100:00100000:3.0:1787692385.602140:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787692385.602161:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125873920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692385.602234:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692385.602333:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125873920 00000100:00100000:0.0:1787692385.602340:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125873920 00000100:00100000:0.0:1787692385.602400:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787692385.602411:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125873920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787692385.602433:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692385.602481:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125873920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692385.602488:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787692385.602521:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb4b43480 x1874531125873920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692385.602537:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4b43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125873920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787692385.796408:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692386.625021:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaec74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125874048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692386.625094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692386.625173:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125874048 00000100:00100000:2.0:1787692386.625182:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125874048 00000100:00100000:2.0:1787692386.625319:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787692386.625330:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125874048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787692386.625438:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692386.625493:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125874048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692386.625502:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787692386.625522:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaec74380 x1874531125874048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692386.625550:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaec74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125874048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787692386.818694:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692387.841186:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787692388.174978:0:11608:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1787692388.868518:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787692389.109900:0:11656:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0f5141c0 20000000:00000080:2.0:1787692389.109918:0:11656:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92ec87e64c00 uarg=0000000000000000 20000000:01000000:2.0:1787692389.109954:0:11656:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787692389.109960:0:11656:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787692389.109965:0:11656:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787692389.111458:0:11657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1787692389.111605:0:11656:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1787692389.117971:0:11656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1787692389.118026:0:11656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1787692389.118088:0:11656:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1787692389.118105:0:11656:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787692389.118123:0:11656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.118140:0:11656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de3b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21e8 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.118148:0:11656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de3bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21ef expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.118156:0:11656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92eca6425200/0x5d8b8560a09de3cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de3c6 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.118163:0:11656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de3db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de3d4 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.118170:0:11656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de3e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de3e2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.118177:0:11656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.118214:0:11656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de3e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de3e2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.118237:0:11656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de3e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de3e2 expref: 18 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692389.118252:0:11656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecae9fea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1874531125874176:0@lo:104: 00000100:00100000:1.0:1787692389.118320:0:11656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787692389.118684:0:11656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de3db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de3d4 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.118693:0:11656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de3db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de3d4 expref: 18 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692389.118702:0:11656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1874531125874304:0@lo:104: 00000100:00100000:1.0:1787692389.118726:0:11656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787692389.119111:0:11656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92eca6425200/0x5d8b8560a09de3cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09de3c6 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.119119:0:11656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff92eca6425200/0x5d8b8560a09de3cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09de3c6 expref: 18 pid: 5825 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692389.119127:0:11656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1874531125874432:0@lo:104: 00000100:00100000:1.0:1787692389.119151:0:11656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692389.119210:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125874176 00000100:00100000:3.0:1787692389.119218:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125874176 00000100:00100000:3.0:1787692389.119266:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125874304 00000100:00100000:3.0:1787692389.119270:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125874304 00000100:00100000:3.0:1787692389.119294:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787692389.119301:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+4:11656:x1874531125874176:12345-0@lo:104: 00010000:00010000:3.0:1787692389.119313:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de3e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119366:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787692389.119372:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+4:11656:x1874531125874176:12345-0@lo:104: Request processed in 72us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692389.119379:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787692389.119395:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787692389.119401:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+3:11656:x1874531125874304:12345-0@lo:104: 00010000:00010000:3.0:1787692389.119409:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de3db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119442:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787692389.119447:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+3:11656:x1874531125874304:12345-0@lo:104: Request processed in 47us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692389.119453:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1787692389.119469:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787692389.119474:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de3e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119481:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d6400 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:3.0:1787692389.119493:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de3e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119501:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de3e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787692389.119507:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de3e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692389.119513:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787692389.119538:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de3e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119555:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787692389.119579:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de3e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119586:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec813d6400/0x5d8b8560a09de3e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de3e9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119599:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692389.119603:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de3db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119608:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2a00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:3.0:1787692389.119611:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de3db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119617:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de3db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787692389.119633:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de3db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692389.119639:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787692389.119658:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de3db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119664:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787692389.119670:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de3db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119677:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec814a2a00/0x5d8b8560a09de3d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de3db expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119686:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692389.119688:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692389.119689:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692389.119696:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692389.119713:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125874560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787692389.119742:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692389.119765:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787692389.119771:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125874688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787692389.119790:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692389.119844:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125874560 00000100:00100000:3.0:1787692389.119848:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125874560 00010000:00010000:3.0:1787692389.119866:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de3e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de3e2 expref: 19 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692389.119885:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125874688 00000100:00100000:3.0:1787692389.119895:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125874688 00010000:00010000:3.0:1787692389.119907:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de3db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de3d4 expref: 20 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692389.119926:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787692389.119932:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74f850a3-c102-416a-ae3b-08438aa77de6+20:3304:x1874531125874560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692389.119941:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692389.119946:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de3e9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de3e2 expref: 20 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119957:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de3e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de3e2 expref: 20 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.119971:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692389.120000:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74f850a3-c102-416a-ae3b-08438aa77de6+20:3304:x1874531125874560:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692389.120005:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787692389.120018:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787692389.120023:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125874688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692389.120030:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692389.120034:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de3db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de3d4 expref: 19 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.120042:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de3db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de3d4 expref: 19 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.120049:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692389.120069:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125874688:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692389.120075:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787692389.120121:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125874688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787692389.120130:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125874560:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787692389.120392:0:11656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de3bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21ef expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.120404:0:11656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de3bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21ef expref: 12 pid: 5826 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692389.120413:0:11656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1874531125874816:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692389.120482:0:11656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de3b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21e8 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.120490:0:11656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de3b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21e8 expref: 12 pid: 5823 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692389.120498:0:11656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1874531125874944:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692389.120519:0:11656:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecbc3c09c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787692389.120532:0:11656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a3800/0x5d8b8560a09de3e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de3e2 expref: 18 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692389.121020:0:11656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecae9fea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1874531125874176:0@lo:104: 00010000:00010000:1.0:1787692389.121037:0:11656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a2200/0x5d8b8560a09de3db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de3d4 expref: 17 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692389.121044:0:11656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1874531125874304:0@lo:104: 00000100:00100000:3.0:1787692389.121183:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787692389.121196:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125874432 00000100:00100000:3.0:1787692389.121201:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125874432 00000100:00100000:3.0:1787692389.121239:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787692389.121247:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5324850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+3:11656:x1874531125874432:12345-0@lo:104: 00010000:00010000:3.0:1787692389.121258:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de3cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.121319:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787692389.121324:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5324850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:74f850a3-c102-416a-ae3b-08438aa77de6+3:11656:x1874531125874432:12345-0@lo:104: Request processed in 79us (2173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692389.121330:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787692389.121369:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692389.121375:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09de3cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.121382:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d7a00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:3.0:1787692389.121386:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09de3cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.121394:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09de3cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787692389.121401:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09de3cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692389.121407:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787692389.121440:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de3cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.121447:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787692389.121465:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de3cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.121470:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec813d7a00/0x5d8b8560a09de3c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09de3cd expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.121485:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692389.121487:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692389.121488:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692389.121499:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125875072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787692389.121527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692389.121685:0:11656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1874531125874432:0@lo:104: 00000100:00100000:3.0:1787692389.121746:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125875072 00000100:00100000:3.0:1787692389.121751:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125875072 00010000:00010000:3.0:1787692389.121768:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92eca6425200/0x5d8b8560a09de3cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de3c6 expref: 17 pid: 5825 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692389.121794:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787692389.121801:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74f850a3-c102-416a-ae3b-08438aa77de6+17:3306:x1874531125875072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692389.122157:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692389.122164:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92eca6425200/0x5d8b8560a09de3cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09de3c6 expref: 17 pid: 5825 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.122175:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92eca6425200/0x5d8b8560a09de3cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09de3c6 expref: 17 pid: 5825 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.122188:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6425200/0x5d8b8560a09de3cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09de3c6 expref: 17 pid: 5825 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692389.122207:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692389.122348:0:11656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1874531125874816:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692389.122358:0:11656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11656:1874531125874944:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692389.122385:0:11656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692389.122433:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74f850a3-c102-416a-ae3b-08438aa77de6+16:3306:x1874531125875072:12345-0@lo:103:ldlm_bl.0 Request processed in 631us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692389.122440:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787692389.122746:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125875072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787692389.123686:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692389.123710:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692389.123776:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108016512 00000100:00100000:0.0:1787692389.123782:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108016512 00010000:00010000:0.0:1787692389.123861:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de3bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21ef expref: 13 pid: 5826 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692389.123888:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108016640 00000100:00100000:0.0:1787692389.123891:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108016640 00010000:00010000:0.0:1787692389.123906:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de3b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21e8 expref: 14 pid: 5823 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692389.123927:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:0.0:1787692389.123936:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0696784b-1191-4b0f-b755-3a72c69e021b+14:2361:x1874531108016512:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692389.123946:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692389.123951:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de3bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21ef expref: 14 pid: 5826 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.123961:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de3bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21ef expref: 14 pid: 5826 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.123975:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de3bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21ef expref: 14 pid: 5826 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.123987:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692389.124023:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2361:x1874531108016512:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 89us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692389.124030:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:0.0:1787692389.124043:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:0.0:1787692389.124050:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0696784b-1191-4b0f-b755-3a72c69e021b+12:2361:x1874531108016640:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692389.124056:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692389.124060:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de3b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21e8 expref: 12 pid: 5823 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.124075:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de3b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21e8 expref: 12 pid: 5823 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.124084:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec813d7800/0x5d8b8560a09de3b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21e8 expref: 12 pid: 5823 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.124095:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.124103:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.124117:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.124124:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.124131:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.124137:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.124142:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165c00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692389.124147:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.124154:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.124175:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.124187:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692389.124207:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0696784b-1191-4b0f-b755-3a72c69e021b+11:2361:x1874531108016640:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 157us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692389.124213:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 34 00010000:00010000:1.0:1787692389.124300:0:11656:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.124308:0:11656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692389.124321:0:11656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09de516 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787692389.239718:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1787692389.239739:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1787692389.239910:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787692389.240111:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125875200:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787692389.240185:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692389.241053:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125875200 00000100:00100000:0.0:1787692389.241063:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125875200 00000100:00100000:0.0:1787692389.241121:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787692389.241131:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125875200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787692389.241170:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787692389.241203:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8e055f, atime: 0x6a8e055f, ctime: 0x6a8e055f, blocks: 0x1 00010000:00010000:0.0:1787692389.241211:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd73427b/0x5d8b8560a09de51d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.241226:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=295s v=(0 0) 00010000:00010000:0.0:1787692389.241231:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692389.241236:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd73427b/0x5d8b8560a09de51d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.241253:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd73427b/0x5d8b8560a09de51d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.241263:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd73427b/0x5d8b8560a09de51d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.241281:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd73427b/0x5d8b8560a09de51d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.241298:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787692389.242256:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92ecaf6f1f80/2, rc 0, transno 4294967300 00000100:00100000:3.0:1787692389.242266:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125875200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787692389.242305:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874531125875200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1008us (1952us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787692389.242313:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1787692389.242339:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787692389.242352:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692389.242358:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd73427b/0x5d8b8560a09de51d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.242369:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424000 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692389.242374:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd73427b/0x5d8b8560a09de51d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.242384:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd73427b/0x5d8b8560a09de51d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.242400:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd73427b/0x5d8b8560a09de51d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.242408:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd73427b/0x5d8b8560a09de51d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692389.242438:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692389.242440:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692389.242442:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692389.540896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692389.540937:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692389.540947:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108016896 00000100:00100000:1.0:1787692389.540956:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108016896 00000100:00100000:0.0:1787692389.540999:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692389.541027:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 54 00000100:00100000:1.0:1787692389.541036:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2363:x1874531108016896:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692389.541059:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108016768 00000100:00100000:2.0:1787692389.541063:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108016768 00000100:00100000:2.0:1787692389.541090:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108017024 00000100:00100000:2.0:1787692389.541093:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108017024 00000100:00100000:1.0:1787692389.541101:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2363:x1874531108016896:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 67us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692389.541108:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 54 00000100:00080000:0.0:1787692389.541126:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787692389.541131:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787692389.544139:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 93 00000100:00100000:2.0:1787692389.544162:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2364:x1874531108016768:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692389.544619:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 94 00000100:00100000:3.0:1787692389.544634:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2364:x1874531108017024:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692389.544881:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2364:x1874531108016768:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 729us (3942us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692389.544902:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 93 00000100:00100000:3.0:1787692389.552528:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2364:x1874531108017024:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 7885us (11516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692389.552556:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 94 00000001:00080000:3.0:1787692389.758752:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:3.0:1787692389.889019:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692390.209422:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaec77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125875328:0@lo:400:kworker.0 00000100:00100000:3.0:1787692390.209507:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692390.209990:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125875328 00000100:00100000:3.0:1787692390.211118:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787692390.211134:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874531125875456:0@lo:400:kworker.0 00000100:00100000:3.0:1787692390.211204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692390.211252:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125875456 00000100:00100000:3.0:1787692390.211258:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125875456 00000100:00100000:3.0:1787692390.211303:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787692390.211312:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874531125875456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692390.211375:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874531125875456:12345-0@lo:400:kworker.0 Request processed in 65us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692390.211382:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787692390.211419:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874531125875456:0@lo:400:kworker.0 00000100:00100000:3.0:1787692390.212018:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaec74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125875584:0@lo:400:kworker.0 00000100:00100000:3.0:1787692390.212052:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692390.212124:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692390.212130:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125875712:0@lo:400:kworker.0 00000100:00100000:1.0:1787692390.212157:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125875328 00000100:00100000:1.0:1787692390.212211:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1787692390.212223:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:3304:x1874531125875328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692390.212266:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125875840:0@lo:400:kworker.0 00000100:00100000:1.0:1787692390.212269:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+16:3304:x1874531125875328:12345-0@lo:400:kworker.0 Request processed in 48us (2761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.212279:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787692390.212309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692390.212328:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125875584 00000100:00100000:1.0:1787692390.212333:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125875584 00000100:00100000:2.0:1787692390.212344:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaec77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125875328:0@lo:400:kworker.0 00000100:00100000:2.0:1787692390.212359:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787692390.212367:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125875968:0@lo:400:kworker.0 00000100:00100000:1.0:1787692390.212367:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125875840 00000100:00100000:1.0:1787692390.212372:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125875840 00000100:00100000:2.0:1787692390.212397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692390.212403:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787692390.212412:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125875584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692390.212454:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125875584:12345-0@lo:400:kworker.0 Request processed in 44us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.212460:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787692390.212470:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787692390.212476:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125875840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692390.212499:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125875840:12345-0@lo:400:kworker.0 Request processed in 24us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.212504:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1787692390.212517:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692390.212537:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125875840:0@lo:400:kworker.0 00000100:00100000:1.0:1787692390.212578:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125875968 00000100:00100000:1.0:1787692390.212582:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125875968 00000100:00100000:1.0:1787692390.212608:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787692390.212616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692390.212618:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125875968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692390.212652:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaec74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125875584:0@lo:400:kworker.0 00000100:00100000:1.0:1787692390.212665:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125875968:12345-0@lo:400:kworker.0 Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.212672:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787692390.212679:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125875712 00000100:00100000:3.0:1787692390.212684:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125875712 00000100:00100000:1.0:1787692390.212704:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787692390.212709:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92ecaf6f1f80, transno 4294967300 00000100:00100000:1.0:1787692390.212721:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125875968:0@lo:400:kworker.0 00000100:00100000:3.0:1787692390.212735:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787692390.212745:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125875712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692390.213025:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125875712:12345-0@lo:400:kworker.0 Request processed in 281us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692390.213034:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787692390.213054:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787692390.213116:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaec75180 x1874531125875712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692390.213126:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125875712:0@lo:400:kworker.0 10000000:01000000:3.0:1787692390.272893:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787692390.272899:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92eb85134000 from 7 10000000:01000000:3.0:1787692390.272904:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787692390.272944:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692390.272955:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692390.272966:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692390.273000:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125876096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787692390.273060:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692390.273110:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9068f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787692390.273422:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125876096 00000100:00100000:1.0:1787692390.273430:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125876096 00000100:00100000:1.0:1787692390.273486:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787692390.273496:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+16:5828:x1874531125876096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787692390.273518:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692390.273532:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec88164400/0x5d8b8560a09de52b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de524 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692390.273554:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec88164400/0x5d8b8560a09de52b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de524 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692390.273575:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec88164400/0x5d8b8560a09de52b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de524 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692390.273584:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164400, rc 0) 00000100:00100000:1.0:1787692390.273640:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125876096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.273648:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787692390.273882:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125876096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692390.273898:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692390.273909:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692390.274428:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125876224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787692390.274479:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692390.274511:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a46240 going to sleep for 11 seconds 00000100:00100000:1.0:1787692390.274921:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125876224 00000100:00100000:1.0:1787692390.274928:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125876224 00000100:00100000:1.0:1787692390.275029:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787692390.275038:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125876224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692390.275274:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125876224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.275282:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787692390.276625:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125876224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787692390.276678:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125876352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787692390.276735:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692390.279505:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125876352 00000100:00100000:0.0:1787692390.279551:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a46240 going to sleep for 11 seconds 00000100:00100000:3.0:1787692390.281436:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125876352 00000100:00100000:3.0:1787692390.281514:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1787692390.281525:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125876352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787692390.282228:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125876352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 703us (5489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692390.282237:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1787692390.282386:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125876352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692390.283098:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:11670:1874531125876480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692390.283150:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692390.283189:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecbc3c0300 going to sleep for 11 seconds 00000100:00100000:3.0:1787692390.283314:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125876480 00000100:00100000:3.0:1787692390.283320:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125876480 00000100:00100000:3.0:1787692390.283353:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1787692390.283361:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:11670:x1874531125876480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692390.284018:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:11670:x1874531125876480:12345-0@lo:502:llog_process_th.0 Request processed in 654us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692390.284027:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787692390.284167:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:11670:1874531125876480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787692390.284192:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787692390.284200:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692390.284206:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787692390.284213:0:11670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92eb85134000 00000020:00000080:1.0:1787692390.284215:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787692390.284329:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:11670:1874531125876608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692390.284360:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692390.284399:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecbc3c0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787692390.284454:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125876608 00000100:00100000:2.0:1787692390.284459:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125876608 00000100:00100000:2.0:1787692390.284490:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787692390.284496:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+17:11670:x1874531125876608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787692390.284642:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+17:11670:x1874531125876608:12345-0@lo:502:llog_process_th.0 Request processed in 145us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692390.284648:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1787692390.284776:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:11670:1874531125876608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787692390.284806:0:11670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692390.284835:0:11670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692390.284837:0:11670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787692390.284841:0:11670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787692390.284995:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787692390.285022:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787692390.285033:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692390.285044:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692390.285054:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787692390.285063:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ecafbbe800 from 7 10000000:01000000:3.0:1787692390.285077:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787692390.285101:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692390.285109:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692390.285118:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692390.285133:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125876736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787692390.285163:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692390.285192:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9068f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787692390.285638:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125876736 00000100:00100000:1.0:1787692390.285644:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125876736 00000100:00100000:1.0:1787692390.285697:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787692390.285705:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+17:5828:x1874531125876736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787692390.285716:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692390.285728:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec88165600/0x5d8b8560a09de539 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de532 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692390.285749:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec88165600/0x5d8b8560a09de539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de532 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692390.285758:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec88165600/0x5d8b8560a09de539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de532 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692390.285767:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165600, rc 0) 00000100:00100000:1.0:1787692390.285857:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125876736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.285864:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1787692390.286024:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125876736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787692390.286039:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692390.286047:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692390.286095:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125876864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787692390.286122:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692390.286150:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9068f300 going to sleep for 11 seconds 00000100:00100000:1.0:1787692390.288146:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125876864 00000100:00100000:1.0:1787692390.288159:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125876864 00000100:00100000:1.0:1787692390.288221:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787692390.288232:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125876864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692390.288523:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125876864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 293us (2398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.288531:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787692390.288639:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125876864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692390.288684:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125876992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787692390.288729:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692390.288761:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90326300 going to sleep for 11 seconds 00000100:00100000:3.0:1787692390.288900:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125876992 00000100:00100000:3.0:1787692390.288905:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125876992 00000100:00100000:3.0:1787692390.288940:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1787692390.288947:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec87ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125876992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787692390.289087:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec87ee7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125876992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692390.289101:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787692390.289188:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125876992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787692390.290190:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:11671:1874531125877120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787692390.290249:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692390.290286:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90326d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787692390.290405:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125877120 00000100:00100000:3.0:1787692390.290411:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125877120 00000100:00100000:3.0:1787692390.290452:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787692390.290460:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:11671:x1874531125877120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692390.290649:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec84591050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:11671:x1874531125877120:12345-0@lo:502:llog_process_th.0 Request processed in 189us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692390.290668:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787692390.291220:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f50e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:11671:1874531125877120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787692390.291251:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787692390.291261:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692390.291263:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787692390.291270:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92ecafbbe800 00000020:00000080:1.0:1787692390.291273:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787692390.298642:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:11671:1874531125877248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692390.298734:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692390.298774:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecbc3c09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692390.301516:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125877248 00000100:00100000:3.0:1787692390.301530:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125877248 00000100:00100000:3.0:1787692390.301606:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787692390.301616:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+18:11671:x1874531125877248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692390.302266:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec84591c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+18:11671:x1874531125877248:12345-0@lo:502:llog_process_th.0 Request processed in 649us (3530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692390.302276:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787692390.302514:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:11671:1874531125877248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787692390.302550:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692390.302558:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692390.302560:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787692390.302577:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787692390.303497:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787692390.303519:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787692390.303528:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692390.303540:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692390.303551:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787692390.303553:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ec9dbcc000 from 7 10000000:01000000:3.0:1787692390.303556:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787692390.303600:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692390.303617:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692390.303635:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692390.303932:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125877376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787692390.303989:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692390.304029:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9068ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787692390.304229:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125877376 00000100:00100000:0.0:1787692390.304242:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125877376 00000100:00100000:0.0:1787692390.306346:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787692390.306375:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+18:5828:x1874531125877376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692390.306403:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692390.306421:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6424000/0x5d8b8560a09de547 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09de540 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692390.306451:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6424000/0x5d8b8560a09de547 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09de540 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692390.306462:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6424000/0x5d8b8560a09de547 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09de540 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692390.306471:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6424000, rc 0) 00000100:00100000:0.0:1787692390.306544:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec84592450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125877376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (2553us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692390.306551:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787692390.306589:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125877376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787692390.306611:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692390.306621:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692390.306686:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125877504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787692390.306719:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692390.315631:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9068ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787692390.316007:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125877504 00000100:00100000:1.0:1787692390.316016:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125877504 00000100:00100000:1.0:1787692390.316061:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787692390.316081:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125877504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692390.316339:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125877504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (9618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.316357:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787692390.316713:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692390.318157:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108017152 00000100:00100000:3.0:1787692390.318168:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108017152 00000100:00100000:3.0:1787692390.318938:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 257 00000100:00100000:3.0:1787692390.318952:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+11:5602:x1874531108017152:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787692390.318968:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692390.318984:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de54e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b223c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692390.319035:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de54e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b223c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692390.319047:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de54e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b223c expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692390.319056:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35ba00, rc 0) 00000100:00100000:3.0:1787692390.319227:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+12:5602:x1874531108017152:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 278us (2515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692390.319233:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 257 00000100:00100000:3.0:1787692390.319289:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125877504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787692390.319334:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125877632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787692390.319388:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692390.319426:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9068ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787692390.319575:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125877632 00000100:00100000:1.0:1787692390.319580:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125877632 00000100:00100000:1.0:1787692390.319619:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787692390.319627:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125877632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692390.319795:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:5828:x1874531125877632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.319803:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787692390.322333:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:74f850a3-c102-416a-ae3b-08438aa77de6:5828:1874531125877632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787692390.325037:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787692390.325243:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:11675:1874531125877760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787692390.325318:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692390.325359:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a46180 going to sleep for 11 seconds 00000100:00100000:1.0:1787692390.325452:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125877760 00000100:00100000:1.0:1787692390.325460:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125877760 00000100:00100000:1.0:1787692390.325507:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787692390.325517:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:11675:x1874531125877760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692390.325752:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:11675:x1874531125877760:12345-0@lo:502:llog_process_th.0 Request processed in 236us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.325760:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787692390.325860:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:11675:1874531125877760:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787692390.326024:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787692390.326035:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692390.326037:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787692390.326045:0:11675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92ec9dbcc000 00000020:00000080:0.0:1787692390.326048:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787692390.326320:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:11675:1874531125877888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787692390.326363:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692390.326379:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a46180 going to sleep for 11 seconds 00000100:00100000:2.0:1787692390.326772:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692390.326828:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125877888 00000100:00100000:0.0:1787692390.326834:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125877888 00000100:00100000:0.0:1787692390.326872:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108017280 00000100:00100000:0.0:1787692390.327007:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108017280 00000100:00100000:0.0:1787692390.327039:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787692390.327049:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:11675:x1874531125877888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692390.327256:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 261 00000100:00100000:1.0:1787692390.327268:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+12:5602:x1874531108017280:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787692390.327439:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:11675:x1874531125877888:12345-0@lo:502:llog_process_th.0 Request processed in 390us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692390.327447:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787692390.327499:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+12:5602:x1874531108017280:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 233us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.327507:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 261 00000100:00100000:0.0:1787692390.327512:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:74f850a3-c102-416a-ae3b-08438aa77de6:11675:1874531125877888:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787692390.327542:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787692390.327549:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692390.327551:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787692390.327554:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1787692390.327854:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787692390.327874:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787692390.327883:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692390.327904:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692390.333920:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692390.334752:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108017408 00000100:00100000:0.0:1787692390.334763:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108017408 00000100:00100000:0.0:1787692390.340801:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 262 00000100:00100000:0.0:1787692390.340984:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+12:5602:x1874531108017408:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787692390.341376:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+12:5602:x1874531108017408:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 560us (7462us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692390.341385:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 262 00000100:00100000:0.0:1787692390.347664:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692390.347736:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108017536 00000100:00100000:3.0:1787692390.347746:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108017536 00000100:00100000:3.0:1787692390.347798:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 263 00000100:00100000:3.0:1787692390.347935:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+12:9983:x1874531108017536:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787692390.348192:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+12:9983:x1874531108017536:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 383us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692390.348200:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 263 00000100:00100000:3.0:1787692390.351089:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692390.352529:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108017664 00000100:00100000:0.0:1787692390.352541:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108017664 00000100:00100000:0.0:1787692390.352605:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 264 00000100:00100000:0.0:1787692390.352627:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+12:9983:x1874531108017664:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787692390.352891:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+12:9983:x1874531108017664:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 267us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692390.352899:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 264 00000100:00100000:3.0:1787692390.356489:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692390.356549:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108017792 00000100:00100000:0.0:1787692390.356797:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108017792 00000100:00100000:0.0:1787692390.357071:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 265 00000100:00100000:0.0:1787692390.357084:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+12:5602:x1874531108017792:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692390.357101:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692390.357118:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de555 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2243 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692390.357228:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de555 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2243 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692390.357243:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de555 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2243 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692390.357254:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425800, rc 0) 00000100:00100000:0.0:1787692390.357307:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:5602:x1874531108017792:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 226us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692390.357320:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 265 00000100:00100000:0.0:1787692390.370522:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692390.371788:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108017920 00000100:00100000:3.0:1787692390.371800:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108017920 00000100:00100000:2.0:1787692390.372749:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 266 00000100:00100000:2.0:1787692390.372762:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:5602:x1874531108017920:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692390.373205:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:5602:x1874531108017920:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 444us (2690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692390.373215:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 266 00000100:00100000:3.0:1787692390.380730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692390.380841:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108018048 00000100:00100000:1.0:1787692390.380851:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108018048 00000100:00100000:1.0:1787692390.381048:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 267 00000100:00100000:1.0:1787692390.381061:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:5602:x1874531108018048:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692390.381290:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:5602:x1874531108018048:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 232us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.381299:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 267 00000100:00100000:3.0:1787692390.384725:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692390.384883:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108018176 00000100:00100000:2.0:1787692390.384893:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108018176 00000100:00100000:2.0:1787692390.384945:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 268 00000100:00100000:2.0:1787692390.384955:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88a56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:9986:x1874531108018176:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787692390.385191:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88a56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:9986:x1874531108018176:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 235us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692390.385199:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 268 00000100:00100000:2.0:1787692390.388528:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692390.389305:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108018304 00000100:00100000:1.0:1787692390.389316:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108018304 00000100:00100000:1.0:1787692390.389372:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 269 00000100:00100000:1.0:1787692390.389382:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:9986:x1874531108018304:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787692390.389655:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:9986:x1874531108018304:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 273us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692390.389664:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 269 00000100:00100000:2.0:1787692390.721838:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125878016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787692390.721904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692390.722034:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125878016 00000100:00100000:0.0:1787692390.722042:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125878016 00000100:00100000:0.0:1787692390.722098:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787692390.722109:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125878016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787692390.722152:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692390.722213:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125878016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692390.722221:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787692390.722374:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125878016:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787692390.913870:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787692391.362010:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787692391.745136:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692391.745158:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125878144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692391.745225:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692391.745344:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125878144 00000100:00100000:2.0:1787692391.745351:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125878144 00000100:00100000:2.0:1787692391.745408:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787692391.745430:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125878144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787692391.745464:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692391.745520:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125878144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692391.745537:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1787692391.745834:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb4f50a80 x1874531125878144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692407 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692391.745854:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125878144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787692391.941674:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692392.960962:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692393.986509:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692394.655626:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692394.656216:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692394.660032:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692394.660279:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692394.660363:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108018432 00000100:00100000:0.0:1787692394.660376:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108018432 00000100:00100000:0.0:1787692394.660449:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 270 00000100:00100000:0.0:1787692394.660464:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2364:x1874531108018432:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692394.660569:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2364:x1874531108018432:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 109us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692394.660577:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 270 00000100:00100000:0.0:1787692394.660744:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108018688 00000100:00100000:0.0:1787692394.660748:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108018688 00000100:00100000:0.0:1787692394.660788:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:0.0:1787692394.660809:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+5:2364:x1874531108018688:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692394.660874:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+5:2364:x1874531108018688:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 79us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692394.660881:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00080000:0.0:1787692394.660916:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787692394.663985:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108018560 00000100:00100000:2.0:1787692394.664003:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108018560 00000100:00100000:2.0:1787692394.664385:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108018816 00000100:00100000:2.0:1787692394.664390:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108018816 00000100:00100000:2.0:1787692394.664437:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 98 00000100:00100000:2.0:1787692394.664449:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2364:x1874531108018560:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692394.664580:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2364:x1874531108018560:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 132us (8970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692394.664589:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 98 00000100:00100000:2.0:1787692394.664618:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00100000:2.0:1787692394.664626:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2364:x1874531108018816:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692394.664653:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2364:x1874531108018816:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 28us (8443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692394.664660:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00080000:0.0:1787692394.666499:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787692395.009852:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692395.332308:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125878272:0@lo:400:kworker.0 00000100:00100000:1.0:1787692395.332426:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692395.332554:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125878272 00000100:00100000:0.0:1787692395.332564:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125878272 00000100:00100000:0.0:1787692395.332661:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1787692395.332675:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125878272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692395.333932:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125878400:0@lo:400:kworker.0 00000100:00100000:3.0:1787692395.334011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692395.334079:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125878400 00000100:00100000:3.0:1787692395.334087:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125878400 00000100:00100000:3.0:1787692395.334138:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787692395.334146:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125878400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692395.334202:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125878400:12345-0@lo:400:kworker.0 Request processed in 56us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692395.334210:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787692395.334257:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125878400:0@lo:400:kworker.0 00000100:00100000:0.0:1787692395.334942:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125878272:12345-0@lo:400:kworker.0 Request processed in 2266us (2511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692395.334953:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1787692395.335126:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125878272:0@lo:400:kworker.0 00000100:00100000:0.0:1787692395.335388:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125878528:0@lo:400:kworker.0 00000100:00100000:0.0:1787692395.335453:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692395.335528:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125878528 00000100:00100000:1.0:1787692395.335534:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125878528 00000100:00100000:1.0:1787692395.335618:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787692395.335629:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125878528:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787692395.335976:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692395.336348:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125878656:0@lo:400:kworker.0 00000100:00100000:3.0:1787692395.336409:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692395.336599:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125878656 00000100:00100000:2.0:1787692395.336615:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125878656 00000100:00100000:2.0:1787692395.336677:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787692395.336686:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125878656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692395.337150:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125878528:12345-0@lo:400:kworker.0 Request processed in 1520us (1693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692395.337161:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787692395.337194:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125878784:0@lo:400:kworker.0 00000100:00100000:1.0:1787692395.337230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692395.337254:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787692395.337260:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125878912:0@lo:400:kworker.0 00000100:00100000:1.0:1787692395.337283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692395.337313:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125878784 00000100:00100000:1.0:1787692395.337318:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125878784 00000100:00100000:1.0:1787692395.337354:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787692395.337361:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125878784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692395.337413:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125878784:12345-0@lo:400:kworker.0 Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692395.337419:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787692395.337456:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125878784:0@lo:400:kworker.0 00000100:00100000:1.0:1787692395.337496:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125878912 00000100:00100000:1.0:1787692395.337500:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125878912 00000100:00100000:1.0:1787692395.337555:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787692395.337563:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125878912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692395.337602:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125878912:12345-0@lo:400:kworker.0 Request processed in 41us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692395.337621:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787692395.337664:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125878912:0@lo:400:kworker.0 00000100:00080000:1.0:1787692395.337696:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787692395.338118:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787692395.338121:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787692395.338271:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125878656:12345-0@lo:400:kworker.0 Request processed in 1583us (1858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692395.338280:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787692395.338469:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125878528:0@lo:400:kworker.0 00010000:00080000:3.0:1787692395.338576:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb4f52a00 x1874531125878656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692395.339441:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125878656:0@lo:400:kworker.0 00000100:00100000:2.0:1787692395.841274:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125879040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787692395.841347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692395.841479:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125879040 00000100:00100000:0.0:1787692395.841502:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125879040 00000100:00100000:0.0:1787692395.841594:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787692395.841619:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125879040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787692395.841666:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692395.841764:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125879040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692395.841772:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787692395.848655:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125879040:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787692396.033776:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692396.865152:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692396.865174:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125879168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692396.865239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692396.865556:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125879168 00000100:00100000:2.0:1787692396.865565:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125879168 00000100:00100000:2.0:1787692396.865614:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787692396.865622:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125879168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787692396.865654:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692396.865705:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125879168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692396.865712:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1787692396.865842:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb4f50700 x1874531125879168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692412 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692396.865859:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125879168:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787692397.056979:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692398.081075:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692399.105482:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692399.779676:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692399.779738:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692399.779790:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692399.779847:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108019072 00000100:00100000:3.0:1787692399.779862:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108019072 00000100:00100000:0.0:1787692399.779873:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692399.779946:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108019328 00000100:00100000:3.0:1787692399.779951:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108019328 00000100:00100000:1.0:1787692399.780205:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 103 00000100:00100000:1.0:1787692399.780223:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531108019072:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692399.780334:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531108019072:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 117us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692399.780343:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 103 00000100:00100000:1.0:1787692399.780374:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108019200 00000100:00100000:1.0:1787692399.780379:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108019200 00000100:00080000:0.0:1787692399.780433:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787692399.780435:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00080000:0.0:1787692399.780440:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692399.780447:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531108019200:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692399.780499:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531108019200:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 41us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692399.780507:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:2.0:1787692399.780982:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108018944 00000100:00100000:2.0:1787692399.780989:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108018944 00000100:00100000:2.0:1787692399.781035:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 272 00000100:00100000:2.0:1787692399.781044:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108018944:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692399.781094:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108018944:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 50us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692399.781102:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 272 00000100:00100000:0.0:1787692399.781473:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 104 00000100:00100000:0.0:1787692399.781508:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108019328:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692399.781555:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108019328:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 74us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692399.781564:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 104 00010000:00010000:3.0:1787692400.129677:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692400.450021:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125879680:0@lo:400:kworker.0 00000100:00100000:2.0:1787692400.450028:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125879424:0@lo:400:kworker.0 00000100:00100000:1.0:1787692400.450999:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125879296:0@lo:400:kworker.0 00000100:00100000:3.0:1787692400.451611:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692400.451721:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787692400.451730:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125879552:0@lo:400:kworker.0 00000100:00100000:3.0:1787692400.451764:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692400.451963:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125879680 00000100:00100000:3.0:1787692400.451975:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125879680 00000100:00100000:3.0:1787692400.452048:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787692400.452059:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125879680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692400.452124:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125879680:12345-0@lo:400:kworker.0 Request processed in 66us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692400.452131:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787692400.452158:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125879552 00000100:00100000:3.0:1787692400.452162:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125879552 00000100:00100000:3.0:1787692400.452193:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787692400.452199:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125879552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692400.452229:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125879552:12345-0@lo:400:kworker.0 Request processed in 31us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692400.452253:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1787692400.452277:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787692400.452282:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787692400.452313:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125879552:0@lo:400:kworker.0 00010000:00080000:3.0:1787692400.452329:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb4f50e00 x1874531125879680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692400.452340:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125879680:0@lo:400:kworker.0 00000100:00100000:2.0:1787692400.460495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692400.460593:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125879936:0@lo:400:kworker.0 00000100:00100000:1.0:1787692400.460620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692400.460644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692400.460716:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125879936 00000100:00100000:2.0:1787692400.460726:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125879936 00000100:00100000:2.0:1787692400.460797:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787692400.460808:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125879936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692400.460916:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125879936:12345-0@lo:400:kworker.0 Request processed in 109us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692400.460925:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1787692400.460950:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787692400.460987:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125879936:0@lo:400:kworker.0 00000100:00100000:1.0:1787692400.461389:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125879808:0@lo:400:kworker.0 00000100:00100000:1.0:1787692400.461427:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692400.462026:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125879296 00000100:00100000:0.0:1787692400.462038:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125879296 00000100:00100000:0.0:1787692400.462104:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1787692400.462117:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125879296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692400.462182:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125879296:12345-0@lo:400:kworker.0 Request processed in 70us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692400.462190:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1787692400.462660:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125879296:0@lo:400:kworker.0 00000100:00100000:3.0:1787692400.462767:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125879424 00000100:00100000:3.0:1787692400.462774:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125879424 00000100:00100000:3.0:1787692400.462844:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125879808 00000100:00100000:3.0:1787692400.462848:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125879808 00000100:00100000:3.0:1787692400.462896:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787692400.462904:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125879424:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787692400.462926:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692400.462962:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787692400.462972:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125879424:12345-0@lo:400:kworker.0 Request processed in 67us (2487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692400.462977:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125879808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692400.462983:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787692400.463054:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125879808:12345-0@lo:400:kworker.0 Request processed in 83us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692400.463062:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787692400.463214:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125879808:0@lo:400:kworker.0 00000100:00100000:2.0:1787692400.469623:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb4f52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125879424:0@lo:400:kworker.0 00000100:00100000:3.0:1787692400.961934:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125880064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692400.962030:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692400.962250:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125880064 00000100:00100000:2.0:1787692400.962261:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125880064 00000100:00100000:2.0:1787692400.962323:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787692400.962333:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125880064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787692400.962381:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692400.962444:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125880064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692400.962453:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787692400.962623:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125880064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787692401.152959:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787692401.601944:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787692401.985511:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125880192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787692401.985608:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692401.985798:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125880192 00000100:00100000:0.0:1787692401.985810:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125880192 00000100:00100000:0.0:1787692401.986294:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787692401.986310:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125880192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787692401.986354:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692401.987303:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125880192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 992us (1688us total) trans 0 rc 0/0 00010000:00080000:1.0:1787692401.987309:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaec75180 x1874531125880192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692401.987336:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787692401.987343:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaec75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125880192:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787692402.177122:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692403.202690:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692404.226230:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692404.901966:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692404.902023:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692404.902045:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108019456 00000100:00100000:2.0:1787692404.902059:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108019456 00000100:00100000:2.0:1787692404.902133:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 274 00000100:00100000:2.0:1787692404.902146:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2361:x1874531108019456:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692404.902246:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2361:x1874531108019456:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 102us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692404.902254:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 274 00000100:00100000:3.0:1787692404.902440:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108019584 00000100:00100000:3.0:1787692404.902446:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108019584 00000100:00100000:3.0:1787692404.902538:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 108 00000100:00100000:3.0:1787692404.902547:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108019584:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692404.902598:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108019584:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 53us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692404.902606:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 108 00000100:00080000:2.0:1787692404.903595:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692404.916192:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692404.916308:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108019840 00000100:00100000:1.0:1787692404.916320:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108019840 00000100:00100000:1.0:1787692404.916416:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 109 00000100:00100000:1.0:1787692404.916428:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2361:x1874531108019840:12345-192.168.206.27@tcp:400:kworker.0 00000100:00080000:2.0:1787692404.916854:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692404.916930:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2361:x1874531108019840:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 502us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692404.916940:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 109 00000100:00100000:0.0:1787692404.920228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692404.920316:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108019712 00000100:00100000:3.0:1787692404.920329:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108019712 00000100:00100000:3.0:1787692404.920474:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:3.0:1787692404.920500:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+5:2360:x1874531108019712:12345-192.168.206.27@tcp:9:kworker.0 00000020:00000080:3.0:1787692404.920537:0:8080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de491 00000100:00080000:3.0:1787692404.920549:0:8080:0:(import.c:65:import_set_state_nolock()) ffff92ec8780c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787692404.920608:0:8080:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1787692404.920989:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+2:2360:x1874531108019712:12345-192.168.206.27@tcp:9:kworker.0 Request processed in 503us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692404.921010:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00010000:00010000:1.0:1787692404.921106:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787692404.928363:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1787692405.111012:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 067f46f5-4779-40e6-b53d-5b3e89751501 00000020:00000080:0.0:1787692405.111026:0:7630:0:(genops.c:885:class_export_put()) final put ffff92ec8780a000/067f46f5-4779-40e6-b53d-5b3e89751501 00000020:00000080:1.0:1787692405.111124:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec8780a000/067f46f5-4779-40e6-b53d-5b3e89751501 for lustre-OST0001 00000020:00000080:1.0:1787692405.111189:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ec8780c800 for lustre-OST0001 00010000:00010000:3.0:1787692405.249099:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692405.569637:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125880448:0@lo:400:kworker.0 00000100:00100000:1.0:1787692405.569657:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125880576:0@lo:400:kworker.0 00000100:00100000:3.0:1787692405.569745:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125880320:0@lo:400:kworker.0 00000100:00100000:0.0:1787692405.570416:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125880704:0@lo:400:kworker.0 00000100:00100000:1.0:1787692405.570546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692405.570662:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125880576 00000100:00100000:1.0:1787692405.570672:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125880576 00000100:00100000:1.0:1787692405.570747:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787692405.570761:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125880576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692405.570848:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125880576:12345-0@lo:400:kworker.0 Request processed in 91us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692405.570857:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:1.0:1787692405.570883:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692405.570918:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125880576:0@lo:400:kworker.0 00000100:00100000:3.0:1787692405.571333:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692405.571509:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125880832:0@lo:400:kworker.0 00000100:00100000:3.0:1787692405.571544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692405.572449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692405.572511:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125880960:0@lo:400:kworker.0 00000100:00100000:2.0:1787692405.572571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692405.572718:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125880832 00000100:00100000:3.0:1787692405.572728:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125880832 00000100:00100000:3.0:1787692405.572791:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125880448 00000100:00100000:3.0:1787692405.572794:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125880448 00000100:00100000:3.0:1787692405.572835:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787692405.572846:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125880832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692405.572919:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125880832:12345-0@lo:400:kworker.0 Request processed in 75us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692405.572927:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787692405.572944:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787692405.572950:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125880448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692405.572977:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125880448:12345-0@lo:400:kworker.0 Request processed in 27us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692405.572982:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787692405.573030:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125880832:0@lo:400:kworker.0 00000100:00100000:1.0:1787692405.573042:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125880320 00000100:00100000:1.0:1787692405.573049:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125880320 00000100:00100000:3.0:1787692405.573082:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125880960 00000100:00100000:3.0:1787692405.573087:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125880960 00000100:00100000:1.0:1787692405.573096:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1787692405.573106:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125880320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692405.573125:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787692405.573135:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125880960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692405.573159:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125880320:12345-0@lo:400:kworker.0 Request processed in 55us (1826us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692405.573166:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:1.0:1787692405.573211:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787692405.573216:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692405.573526:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125880448:0@lo:400:kworker.0 00000100:00100000:2.0:1787692405.573565:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125880320:0@lo:400:kworker.0 00000100:00100000:3.0:1787692405.573739:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125880960:12345-0@lo:400:kworker.0 Request processed in 605us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692405.573748:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787692405.573803:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125880960:0@lo:400:kworker.0 00000100:00100000:0.0:1787692405.574316:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692405.574401:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125880704 00000100:00100000:3.0:1787692405.574411:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125880704 00000100:00100000:3.0:1787692405.574495:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787692405.574506:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125880704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692405.574563:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125880704:12345-0@lo:400:kworker.0 Request processed in 60us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692405.574569:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1787692405.574649:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787692405.574675:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec878b2a00 x1874531125880704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692405.574689:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125880704:0@lo:400:kworker.0 00000100:00100000:1.0:1787692406.081378:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125881088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787692406.081504:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692406.083602:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125881088 00000100:00100000:3.0:1787692406.083622:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125881088 00000100:00100000:3.0:1787692406.083788:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787692406.083837:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125881088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787692406.083888:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692406.084011:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125881088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 178us (2507us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692406.084019:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787692406.084149:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125881088:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787692406.273139:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692407.106412:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787692407.106441:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125881216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787692407.106540:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692407.106692:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125881216 00000100:00100000:0.0:1787692407.106702:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125881216 00000100:00100000:0.0:1787692407.106779:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787692407.106802:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125881216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787692407.106872:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692407.106931:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125881216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692407.106939:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787692407.107007:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787692407.107087:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec91f47b80 x1874531125881216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692407.107109:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125881216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787692407.297490:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692408.322256:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692409.346178:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692410.015642:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692410.015689:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692410.015712:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692410.015772:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108019968 00000100:00100000:0.0:1787692410.015781:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108019968 00000100:00100000:0.0:1787692410.015857:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 276 00000100:00100000:0.0:1787692410.015870:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:2364:x1874531108019968:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692410.015915:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108020096 00000100:00100000:1.0:1787692410.015921:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108020096 00000100:00100000:0.0:1787692410.015939:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:2364:x1874531108019968:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 72us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692410.015960:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 276 00000100:00100000:1.0:1787692410.015964:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108020224 00000100:00100000:1.0:1787692410.015969:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108020224 00000100:00080000:0.0:1787692410.016102:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692410.016155:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 113 00000100:00100000:0.0:1787692410.023009:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 114 00000100:00100000:0.0:1787692410.023031:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2364:x1874531108020224:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692410.023037:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2364:x1874531108020096:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692410.023116:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2364:x1874531108020224:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 96us (7402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692410.023125:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 114 00000100:00100000:1.0:1787692410.027433:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2364:x1874531108020096:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 11262us (11793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692410.027470:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 113 00010000:00010000:3.0:1787692410.369920:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692410.692201:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125881600:0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.692266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692410.692903:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692410.692913:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125881728:0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.692950:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692410.692997:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125881600 00000100:00100000:0.0:1787692410.693005:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125881600 00000100:00100000:0.0:1787692410.693063:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787692410.693210:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125881600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.693262:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125881600:12345-0@lo:400:kworker.0 Request processed in 56us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692410.693269:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1787692410.693293:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125881728 00000100:00100000:0.0:1787692410.693297:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125881728 00000100:00100000:0.0:1787692410.693338:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787692410.693347:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125881728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.693381:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125881728:12345-0@lo:400:kworker.0 Request processed in 35us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692410.693397:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787692410.693413:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787692410.693418:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787692410.693463:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec878b1180 x1874531125881728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692426 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692410.693477:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125881728:0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.693490:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125881600:0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.693535:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125881472:0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.693563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692410.693581:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125881984:0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.693602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692410.693620:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787692410.693626:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125881344:0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.693652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692410.693693:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125881856:0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.693715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692410.693949:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125881472 00000100:00100000:0.0:1787692410.693954:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125881472 00000100:00100000:0.0:1787692410.694042:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125881856 00000100:00100000:0.0:1787692410.694046:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125881856 00000100:00100000:0.0:1787692410.694150:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787692410.694158:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125881472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.694197:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125881472:12345-0@lo:400:kworker.0 Request processed in 41us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692410.694203:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787692410.694223:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787692410.694230:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125881856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.694260:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125881856:12345-0@lo:400:kworker.0 Request processed in 33us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692410.694266:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787692410.694285:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125881984 00000100:00100000:0.0:1787692410.694288:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125881984 00000100:00100000:0.0:1787692410.694313:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787692410.694321:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125881984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.694350:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125881984:12345-0@lo:400:kworker.0 Request processed in 32us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692410.694356:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787692410.694374:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125881344 00000100:00100000:0.0:1787692410.694377:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125881344 00000100:00100000:0.0:1787692410.694401:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1787692410.694408:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125881344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.694606:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125881344:12345-0@lo:400:kworker.0 Request processed in 199us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692410.694613:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:0.0:1787692410.694639:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787692410.694643:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692410.694665:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125881344:0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.694677:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125881856:0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.694686:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125881472:0@lo:400:kworker.0 00000100:00100000:0.0:1787692410.694694:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125881984:0@lo:400:kworker.0 00000100:00100000:3.0:1787692411.200997:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787692411.201028:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125882112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692411.201093:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692411.201259:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125882112 00000100:00100000:1.0:1787692411.201266:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125882112 00000100:00100000:1.0:1787692411.201318:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787692411.201328:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125882112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787692411.201363:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692411.201441:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125882112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692411.201448:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787692411.201510:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125882112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787692411.393013:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787692411.841776:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787692412.225252:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692412.225277:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125882240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692412.225341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692412.225569:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125882240 00000100:00100000:2.0:1787692412.225578:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125882240 00000100:00100000:2.0:1787692412.225646:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787692412.225656:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125882240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787692412.225689:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692412.225735:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125882240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692412.225742:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787692412.226651:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787692412.226693:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ec91f47b80 x1874531125882240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692412.226718:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125882240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787692412.417027:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787692412.823293:0:11838:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 17:13:31 (1787692411) 00010000:00010000:1.0:1787692413.441217:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692414.221296:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692414.221573:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108020352 00000100:00100000:2.0:1787692414.221583:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108020352 00000100:00100000:2.0:1787692414.221654:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00100000:2.0:1787692414.221664:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+5:10253:x1874531108020352:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692414.221697:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692414.221720:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de55c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b224a expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692414.221781:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de563 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692414.221794:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692414.221806:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692414.222039:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787692414.222044:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692414.222157:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692414.222196:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de55c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b224a expref: 7 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692414.222215:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b224a expref: 6 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692414.222222:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636100) 00010000:00010000:2.0:1787692414.222225:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787692414.222228:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3600, rc 0) 00000100:00100000:2.0:1787692414.222293:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+6:10253:x1874531108020352:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 630us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692414.222301:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00080000:0.0:1787692414.223116:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692414.237049:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692414.237512:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108020480 00000100:00100000:0.0:1787692414.237523:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108020480 00000100:00100000:0.0:1787692414.237721:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:0.0:1787692414.237733:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:10254:x1874531108020480:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787692414.237753:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692414.237772:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de56a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2251 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.237882:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de571 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.237896:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.237907:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.237920:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de578 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.237939:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.237946:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.240636:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de57f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.240658:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de57f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.240669:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de57f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692414.240770:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787692414.240774:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692414.242329:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de57f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242352:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242359:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de571 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242366:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de571 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242372:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692414.242376:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de571 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242393:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de571 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242417:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636100) 00010000:00010000:0.0:1787692414.242421:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692414.242425:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242431:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242456:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242462:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de578 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242468:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242472:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692414.242475:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242481:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de578 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242488:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff92ec832f4c00) 00010000:00010000:0.0:1787692414.242491:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692414.242493:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de578 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242509:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de578 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242569:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de56a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2251 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242581:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de57f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2251 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.242589:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92ec832f4400) 00010000:00010000:0.0:1787692414.242591:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787692414.242593:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6424600, rc 0) 00000100:00100000:0.0:1787692414.242667:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+7:10254:x1874531108020480:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 4937us (5627us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692414.242676:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:3.0:1787692414.248481:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692414.249139:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108020736 00000100:00100000:0.0:1787692414.249149:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108020736 00000100:00100000:0.0:1787692414.249224:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:0.0:1787692414.249236:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:10254:x1874531108020736:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787692414.249257:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692414.249275:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de586 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2258 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.249340:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de58d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.249354:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de58d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.249376:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de58d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.259541:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de594 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.259624:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de594 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.259636:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de594 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.262334:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de59b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.262356:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de59b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.262367:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de59b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692414.262378:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787692414.264716:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de58d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.264732:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de58d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.264740:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de58d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.264745:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692414.264761:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de58d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.264769:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de58d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.264784:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92ec832f4400) 00010000:00010000:0.0:1787692414.264788:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692414.264792:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de58d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.265638:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de58d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.265655:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de594 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.265661:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de594 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.265667:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de594 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.265672:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692414.265676:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de594 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.265682:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de594 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.265692:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff92ec832f4c00) 00010000:00010000:0.0:1787692414.265695:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692414.265708:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de594 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.265714:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de594 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.269334:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de586 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2258 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.269367:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de59b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2258 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692414.269377:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec832f4e00) 00010000:00010000:0.0:1787692414.269380:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692414.269384:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425000, rc 0) 00000100:00100000:0.0:1787692414.270377:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+9:10254:x1874531108020736:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 21136us (21896us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787692414.270388:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:2.0:1787692414.297615:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692414.298966:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108020864 00000100:00100000:1.0:1787692414.298978:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108020864 00000100:00100000:1.0:1787692414.299059:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:1.0:1787692414.299071:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+9:10254:x1874531108020864:12345-192.168.206.27@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787692414.299177:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+9:10254:x1874531108020864:12345-192.168.206.27@tcp:59:lhsmtool_posix.0 Request processed in 109us (1571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692414.299192:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 35 00010000:00010000:2.0:1787692414.466414:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787692414.847794:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000040:00080000:0.0:1787692414.913420:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787692415.138425:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692415.138481:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692415.138525:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692415.138643:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108020992 00000100:00100000:1.0:1787692415.138657:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108020992 00000100:00100000:2.0:1787692415.138709:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108021120 00000100:00100000:2.0:1787692415.138715:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108021120 00000100:00100000:1.0:1787692415.138740:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 278 00000100:00100000:1.0:1787692415.138753:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108020992:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692415.138759:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108021248 00000100:00100000:2.0:1787692415.138764:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108021248 00000100:00100000:2.0:1787692415.138801:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 118 00000100:00100000:2.0:1787692415.138835:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+8:2361:x1874531108021120:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692415.138878:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108020992:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 126us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692415.138882:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+8:2361:x1874531108021120:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 72us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692415.138892:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 278 00000100:00100000:2.0:1787692415.138894:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 118 00000100:00100000:2.0:1787692415.138918:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 119 00000100:00100000:2.0:1787692415.138927:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108021248:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692415.138954:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108021248:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692415.138961:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 119 00000100:00080000:2.0:1787692415.138988:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787692415.491656:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692415.810267:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125882752:0@lo:400:kworker.0 00000100:00100000:3.0:1787692415.810363:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692415.811385:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125882496:0@lo:400:kworker.0 00000100:00100000:1.0:1787692415.811453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692415.814297:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787692415.814342:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125882624:0@lo:400:kworker.0 00000100:00100000:1.0:1787692415.814620:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125883008:0@lo:400:kworker.0 00000100:00100000:3.0:1787692415.814651:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692415.814667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692415.814722:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787692415.814732:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125882368:0@lo:400:kworker.0 00000100:00100000:1.0:1787692415.814769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692415.814889:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125882752 00000100:00100000:0.0:1787692415.814900:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125882752 00000100:00100000:2.0:1787692415.814905:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125882496 00000100:00100000:2.0:1787692415.814913:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125882496 00000100:00080000:3.0:1787692415.814985:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787692415.814988:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125883008 00000100:00100000:0.0:1787692415.814994:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125883008 00000100:00100000:0.0:1787692415.815042:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787692415.815056:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125882752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692415.815127:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125882752:12345-0@lo:400:kworker.0 Request processed in 75us (4764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692415.815144:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787692415.815165:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787692415.815175:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125883008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692415.815208:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125883008:12345-0@lo:400:kworker.0 Request processed in 37us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692415.815214:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1787692415.815232:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787692415.815272:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecb5332300 x1874531125882752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787692431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692415.815290:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125882752:0@lo:400:kworker.0 00000100:00100000:0.0:1787692415.815339:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125882624 00000100:00100000:0.0:1787692415.815343:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125882624 00000100:00100000:2.0:1787692415.820037:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787692415.820061:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125882496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692415.820195:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125882496:12345-0@lo:400:kworker.0 Request processed in 142us (8740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692415.820203:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787692415.820596:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787692415.820625:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125882624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692415.820976:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125882624:12345-0@lo:400:kworker.0 Request processed in 73us (6031us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692415.820986:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1787692415.821020:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692415.821069:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125882624:0@lo:400:kworker.0 00000100:00100000:0.0:1787692415.821254:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125882368 00000100:00100000:0.0:1787692415.821262:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125882368 00000100:00100000:0.0:1787692415.821309:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787692415.821319:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125882368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692415.821455:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125882368:12345-0@lo:400:kworker.0 Request processed in 138us (6684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692415.821485:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787692415.823374:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125882368:0@lo:400:kworker.0 00000100:00100000:1.0:1787692415.823395:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125882880:0@lo:400:kworker.0 00000100:00100000:1.0:1787692415.824548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692415.824630:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125882496:0@lo:400:kworker.0 00000100:00100000:1.0:1787692415.824649:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125883008:0@lo:400:kworker.0 00000100:00100000:3.0:1787692415.824762:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125882880 00000100:00100000:3.0:1787692415.824770:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125882880 00000100:00100000:3.0:1787692415.824976:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787692415.824998:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125882880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692415.825085:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125882880:12345-0@lo:400:kworker.0 Request processed in 91us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692415.825093:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787692415.825169:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125882880:0@lo:400:kworker.0 00000100:00080000:0.0:1787692415.825270:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692416.321728:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787692416.321758:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125883136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787692416.321883:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692416.322044:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125883136 00000100:00100000:3.0:1787692416.322054:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125883136 00000100:00100000:3.0:1787692416.322109:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787692416.322120:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125883136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787692416.322189:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692416.322251:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125883136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692416.322260:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787692416.322371:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125883136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787692416.513381:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692416.615282:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692416.615347:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108021376 00000100:00100000:2.0:1787692416.615360:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108021376 00000100:00100000:2.0:1787692416.615495:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:2.0:1787692416.615509:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+8:10296:x1874531108021376:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692416.615534:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692416.615570:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de5a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b225f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.615659:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5b0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.615677:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.615688:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.615704:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de5b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.615711:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.615730:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616072:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5b0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616082:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5b0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616090:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616106:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692416.616111:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5b0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616121:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5b0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616137:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636100) 00010000:00010000:2.0:1787692416.616141:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692416.616147:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616153:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616167:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de5b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616173:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de5b7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616179:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616186:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692416.616189:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de5b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616195:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de5b7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616213:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff92ec94636e00) 00010000:00010000:2.0:1787692416.616215:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692416.616219:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de5b7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616226:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de5b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616268:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de5a9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b225f expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616280:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636100) 00010000:00010000:2.0:1787692416.616283:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692416.616287:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de5a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b225f expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.616297:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3200, rc 0) 00000100:00100000:2.0:1787692416.616377:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+8:10296:x1874531108021376:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 871us (1105us total) trans 0 rc 301/301 00000100:00100000:2.0:1787692416.616387:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00080000:3.0:1787692416.616571:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692416.624939:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692416.625077:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108021632 00000100:00100000:3.0:1787692416.625091:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108021632 00000100:00100000:3.0:1787692416.625164:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:3.0:1787692416.625177:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+8:10296:x1874531108021632:12345-192.168.206.27@tcp:36:lfs.0 00010000:00010000:3.0:1787692416.625249:0:8461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692416.625283:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de563 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b224a expref: 8 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692416.625302:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636100) 00010000:00010000:3.0:1787692416.625316:0:8461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787692416.626856:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de5be lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692416.626883:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de5be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692416.626904:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de5be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692416.626925:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de5c5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692416.629087:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de5c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692416.629116:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de5c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692416.630639:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787692416.630658:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de5be lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.630667:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de5be lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.630675:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de5be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.630688:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35ae00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692416.630694:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de5be lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.630701:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de5be lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.630720:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459ae00) 00010000:00010000:2.0:1787692416.630723:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692416.630728:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de5be lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.630734:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de5be lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787692416.630757:0:8461:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043c20cc9 reply state 00000000ce6fb37e transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de5c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692416.630768:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787692416.630936:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+9:10296:x1874531108021632:12345-192.168.206.27@tcp:36:lfs.0 Request processed in 5756us (6005us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787692416.630945:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 37 00010000:00010000:1.0:1787692416.639295:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de5c5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.639318:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de5c5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.639326:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de5c5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.639345:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692416.639351:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de5c5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.639359:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de5c5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.639378:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff92ec9459a300) 00010000:00010000:1.0:1787692416.639381:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692416.639386:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de5c5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.639392:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de5c5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692416.782185:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692416.782329:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108021760 00000100:00100000:3.0:1787692416.782343:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108021760 00000100:00100000:3.0:1787692416.782435:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:3.0:1787692416.782448:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+8:10305:x1874531108021760:12345-192.168.206.27@tcp:101:lctl.0 00010000:00010000:3.0:1787692416.782480:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692416.782513:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de5cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2266 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692416.782596:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de5d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692416.782612:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692416.782626:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692416.782702:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787692416.782722:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787692416.782775:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692416.782807:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de5cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2266 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692416.782954:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2266 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692416.782964:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a200) 00010000:00010000:3.0:1787692416.782967:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787692416.782971:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35b200, rc 0) 00000100:00100000:3.0:1787692416.783152:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+9:10305:x1874531108021760:12345-192.168.206.27@tcp:101:lctl.0 Request processed in 706us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692416.783161:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:2.0:1787692416.868662:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692416.868957:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108021888 00000100:00100000:1.0:1787692416.868971:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108021888 00000100:00100000:1.0:1787692416.869112:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:1.0:1787692416.869125:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+9:10311:x1874531108021888:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1787692416.869151:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692416.869178:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09de5da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b226d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869275:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de5e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869291:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de5e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869324:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de5e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869342:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de5e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869350:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869356:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869526:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164600/0x5d8b8560a09de5ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869535:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164600/0x5d8b8560a09de5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869542:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164600/0x5d8b8560a09de5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692416.869587:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787692416.869596:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692416.869650:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164600/0x5d8b8560a09de5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869665:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de5e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869671:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de5e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869689:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869695:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692416.869700:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869711:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de5e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869727:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a200) 00010000:00010000:1.0:1787692416.869731:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692416.869742:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de5e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869748:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de5e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869764:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869771:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de5e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869777:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869782:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692416.869785:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869802:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de5e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869810:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff92ec9dbfaf00) 00010000:00010000:1.0:1787692416.869887:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692416.869891:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de5e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869897:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de5e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869935:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09de5da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b226d expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869949:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164600/0x5d8b8560a09de5ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b226d expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.869962:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:1.0:1787692416.869964:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787692416.869966:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164600, rc 0) 00000100:00100000:1.0:1787692416.870058:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+10:10311:x1874531108021888:12345-192.168.206.27@tcp:101:bash.0 Request processed in 937us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692416.870068:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:0.0:1787692416.875765:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692416.875996:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108022144 00000100:00100000:2.0:1787692416.876009:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108022144 00000100:00100000:2.0:1787692416.876210:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:2.0:1787692416.876234:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+10:10311:x1874531108022144:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1787692416.876262:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692416.876306:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de5f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2274 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.876526:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.876548:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.876561:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.876735:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de604 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.876758:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.876770:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787692416.878767:0:8461:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1787692416.879577:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de60b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.879594:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de60b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.879605:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de60b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.879647:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.879667:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.879673:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.879679:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692416.879683:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.879690:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.879702:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:2.0:1787692416.879705:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692416.879710:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.879716:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de5fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787692416.879731:0:8461:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000755374c6 reply state 000000008e8f0d2d transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692416.879739:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787692416.879774:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de5f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2274 expref: 13 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.879789:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de60b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2274 expref: 12 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.879809:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636e00) 00010000:00010000:2.0:1787692416.879852:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692416.879856:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3a00, rc 0) 00000100:00100000:2.0:1787692416.879933:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+13:10311:x1874531108022144:12345-192.168.206.27@tcp:101:bash.0 Request processed in 3712us (4180us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1787692416.879944:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 40 00010000:00010000:0.0:1787692416.884350:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de604 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692416.884374:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de604 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692416.884383:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692416.884911:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692416.884920:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de604 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692416.884932:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de604 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692416.884954:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec94636800) 00010000:00010000:0.0:1787692416.884958:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692416.884964:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de604 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692416.884970:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de604 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692416.889032:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692416.889522:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108022272 00000100:00100000:2.0:1787692416.889536:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108022272 00000100:00100000:2.0:1787692416.889598:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:2.0:1787692416.889608:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1874531108022272:12345-192.168.206.27@tcp:8:bash.0 00010000:00080000:2.0:1787692416.889647:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:2.0:1787692416.889699:0:6681:0:(genops.c:1385:class_connect()) connect: client 067f46f5-4779-40e6-b53d-5b3e89751501, cookie 0x5d8b8560a09de619 00002000:00100000:2.0:1787692416.889715:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 067f46f5-4779-40e6-b53d-5b3e89751501/ffff92ec91d81000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787692416.889745:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787692416.890078:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787692416.890128:0:6681:0:(import.c:65:import_set_state_nolock()) ffff92ec91d85800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787692416.890294:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2360:x1874531108022272:12345-192.168.206.27@tcp:8:bash.0 Request processed in 684us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692416.890303:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:3.0:1787692416.897499:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692416.897710:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108022400 00000100:00100000:0.0:1787692416.897723:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108022400 00000100:00100000:0.0:1787692416.897843:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:0.0:1787692416.897873:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:0:x1874531108022400:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1787692416.897897:0:8080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692416.897925:0:8080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024bf8175/0x5d8b8560a09de620 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b227b expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787692416.897959:0:8080:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692416.897982:0:8080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:0.0:1787692416.897988:0:8080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692416.897999:0:8080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024bf8175/0x5d8b8560a09de620 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b227b expref: 7 pid: 8080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692416.898024:0:8080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000024bf8175/0x5d8b8560a09de620 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b227b expref: 7 pid: 8080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692416.898038:0:8080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425e00, rc 0) 00000100:00100000:0.0:1787692416.898113:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:0:x1874531108022400:12345-192.168.206.27@tcp:101:bash.0 Request processed in 243us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692416.898121:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00080000:3.0:1787692416.898260:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787692416.901078:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692416.901256:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108022528 00000100:00100000:2.0:1787692416.901268:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108022528 00000100:00100000:2.0:1787692416.901339:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:2.0:1787692416.901352:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+7:10311:x1874531108022528:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1787692416.901375:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692416.901443:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2282 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.901485:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024bf8175/0x5d8b8560a09de620 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b227b expref: 8 pid: 8080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.901496:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692416.901502:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692416.901508:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.901552:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024bf8175/0x5d8b8560a09de620 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b227b expref: 8 pid: 8080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692416.901569:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024bf8175/0x5d8b8560a09de620 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b227b expref: 8 pid: 8080 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692416.901586:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1874531125883264:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692416.901723:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca9900 going to sleep for 11 seconds 00000100:00100000:2.0:1787692416.907572:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692416.907776:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f46300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1874531125883264:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692416.907867:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692416.907897:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2400, rc 0) 00000100:00100000:0.0:1787692416.907974:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+8:10311:x1874531108022528:12345-192.168.206.27@tcp:101:bash.0 Request processed in 6623us (6909us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692416.908007:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:1.0:1787692416.913483:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108022656 00000100:00100000:1.0:1787692416.913501:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108022656 00010000:00010000:1.0:1787692416.913566:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024bf8175/0x5d8b8560a09de620 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b227b expref: 8 pid: 8080 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692416.913648:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:1.0:1787692416.913659:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+8:2361:x1874531108022656:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787692416.913678:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692416.913709:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024bf8175/0x5d8b8560a09de620 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b227b expref: 8 pid: 8080 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.913724:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024bf8175/0x5d8b8560a09de620 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b227b expref: 8 pid: 8080 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.913754:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024bf8175/0x5d8b8560a09de620 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b227b expref: 8 pid: 8080 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.913776:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692416.913781:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692416.913790:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.913801:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692416.913906:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692416.913926:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1874531125883392:192.168.206.27@tcp:105: 00000100:00100000:1.0:1787692416.914054:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb22aa540 going to sleep for 11 seconds 00000100:00100000:1.0:1787692416.916872:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1874531125883392:192.168.206.27@tcp:105: 00010000:00010000:1.0:1787692416.916908:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692416.918330:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108022656:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 4654us (10754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692416.918348:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:3.0:1787692416.923068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692416.924133:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108022912 00000100:00100000:0.0:1787692416.924152:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108022912 00000100:00100000:0.0:1787692416.924238:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:0.0:1787692416.924252:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+12:10311:x1874531108022912:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:0.0:1787692416.924735:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+13:10311:x1874531108022912:12345-192.168.206.27@tcp:35:bash.0 Request processed in 485us (1680us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787692416.924746:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:2.0:1787692416.997955:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692416.998184:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108023168 00000100:00100000:3.0:1787692416.998197:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108023168 00000100:00100000:3.0:1787692416.998278:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:3.0:1787692416.998290:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+13:10321:x1874531108023168:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1787692416.998324:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692416.998351:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de62e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2289 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692416.998928:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787692417.001521:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de62e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2289 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.001577:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a200) 00010000:00010000:3.0:1787692417.001581:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787692417.001600:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de62e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2289 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.001621:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35a600, rc 0) 00000100:00100000:3.0:1787692417.001798:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+14:10321:x1874531108023168:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 3508us (3857us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1787692417.001858:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:3.0:1787692417.004297:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692417.004533:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108023424 00000100:00100000:0.0:1787692417.004545:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108023424 00000100:00100000:0.0:1787692417.004615:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:0.0:1787692417.004626:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+14:10321:x1874531108023424:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1787692417.005636:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+15:10321:x1874531108023424:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 1003us (1344us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787692417.005648:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:2.0:1787692417.092059:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692417.092254:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108023552 00000100:00100000:1.0:1787692417.092270:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108023552 00000100:00100000:1.0:1787692417.092358:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:1.0:1787692417.092370:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+15:10327:x1874531108023552:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692417.092411:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692417.092450:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09de63c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2290 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.092538:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de643 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.092555:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.092569:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692417.092648:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787692417.092652:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692417.092682:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.092713:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09de63c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2290 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.092752:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2290 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.092762:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:1.0:1787692417.092765:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787692417.092769:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164200, rc 0) 00000100:00100000:1.0:1787692417.092911:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+16:10327:x1874531108023552:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 542us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692417.092919:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:2.0:1787692417.095983:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692417.096303:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108023808 00000100:00100000:0.0:1787692417.096317:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108023808 00000100:00100000:0.0:1787692417.096578:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:0.0:1787692417.096590:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+16:10327:x1874531108023808:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692417.096616:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692417.096643:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425200/0x5d8b8560a09de64a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2297 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.096782:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de651 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.096863:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.096879:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692417.096894:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787692417.097078:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425200/0x5d8b8560a09de64a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2297 expref: 19 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.097101:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2297 expref: 18 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.097110:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636e00) 00010000:00010000:0.0:1787692417.097113:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692417.097117:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425c00, rc 0) 00000100:00100000:0.0:1787692417.097192:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+18:10327:x1874531108023808:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 605us (1225us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787692417.097201:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:3.0:1787692417.103958:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692417.104011:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692417.104117:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108024064 00000100:00100000:2.0:1787692417.104130:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108024064 00000100:00100000:2.0:1787692417.104262:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:2.0:1787692417.104275:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+18:10327:x1874531108024064:12345-192.168.206.27@tcp:101:lfs.0 00000100:00100000:1.0:1787692417.104299:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108024192 00000100:00100000:1.0:1787692417.104305:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108024192 00010000:00010000:2.0:1787692417.104337:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1787692417.104363:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00010000:00010000:2.0:1787692417.104369:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de65f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b229e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692417.104375:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+19:2362:x1874531108024192:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787692417.104408:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692417.104444:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de651 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2297 expref: 20 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.104468:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636e00) 00010000:00010000:1.0:1787692417.104474:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787692417.104521:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de666 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.104539:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692417.104545:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+19:2362:x1874531108024192:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 173us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692417.104556:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00010000:00010000:2.0:1787692417.104569:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692417.104584:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787692417.104753:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de65f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b229e expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.104771:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de666 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b229e expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.104779:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636e00) 00010000:00010000:2.0:1787692417.104782:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787692417.104785:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2200, rc 0) 00000100:00100000:2.0:1787692417.104846:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+19:10327:x1874531108024064:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 574us (903us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787692417.104854:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:3.0:1787692417.119225:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692417.119621:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108024320 00000100:00100000:1.0:1787692417.119635:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108024320 00000100:00100000:1.0:1787692417.119711:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:1.0:1787692417.119723:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108024320:12345-192.168.206.27@tcp:1:lfs.0 00010000:00010000:1.0:1787692417.119798:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.119853:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.119864:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692417.119870:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787692417.119876:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.119924:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.119941:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 7 pid: 6681 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692417.119958:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874531125883520:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692417.120086:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb22aa540 going to sleep for 11 seconds 00000100:00100000:0.0:1787692417.123802:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874531125883520:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692417.123882:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692417.127387:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692417.128922:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108024448 00000100:00100000:1.0:1787692417.128945:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108024448 00002000:00100000:1.0:1787692417.129037:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff92ecaf67c380 x1874531108024448/t0(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:408/0 lens 504/0 e 0 to 0 dl 1787692428 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787692417.129050:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecaf67c380 with x1874531108024448 ext(0->12) 00010000:00010000:1.0:1787692417.129063:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 8 pid: 6681 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.129113:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 8 pid: 6681 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787692417.129122:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ecaf67c380 00000100:00100000:1.0:1787692417.129169:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:1.0:1787692417.129181:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:067f46f5-4779-40e6-b53d-5b3e89751501+8:2361:x1874531108024448:12345-192.168.206.27@tcp:4:lfs.0 00000001:00100000:2.0:1787692417.165013:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 067f46f5-4779-40e6-b53d-5b3e89751501 00000001:00080000:0.0:1787692417.209892:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1787692417.210108:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108024448:12345-192.168.206.27@tcp:4:lfs.0 Request processed in 80919us (82722us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787692417.210146:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00002000:00100000:2.0:1787692417.210163:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff92ecaf67c380 x1874531108024448/t4294967299(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:408/0 lens 504/448 e 0 to 0 dl 1787692428 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787692417.210175:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecaf67c380 with x1874531108024448 ext(0->12) 00010000:00010000:2.0:1787692417.210188:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 7 pid: 6681 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.210211:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 7 pid: 6681 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787692417.210220:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ecaf67c380 00000100:00100000:1.0:1787692417.213204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692417.214177:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108024576 00000100:00100000:2.0:1787692417.214195:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108024576 00010000:00010000:2.0:1787692417.214262:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 7 pid: 6681 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692417.214313:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:2.0:1787692417.214324:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:2362:x1874531108024576:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692417.214343:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787692417.214367:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787692417.214371:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787692416 00002000:00010000:2.0:1787692417.214373:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787692416 00002000:00010000:2.0:1787692417.214376:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787692416 00002000:00010000:2.0:1787692417.214378:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1787692417.214385:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 7 pid: 6681 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.214561:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 7 pid: 6681 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.214595:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09de627 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2282 expref: 7 pid: 6681 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.214616:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787692417.214621:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787692417.214628:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.214639:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.214679:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692417.214762:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108024576:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 440us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692417.214771:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 36 00010000:00010000:0.0:1787692417.215223:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.215253:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.215286:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.215296:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.215305:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.215313:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165a00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692417.215318:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.215327:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.215354:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.215361:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052291faf/0x5d8b8560a09de674 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692417.215445:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108024320:12345-192.168.206.27@tcp:1:lfs.0 Request processed in 95723us (96232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692417.215453:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:0.0:1787692417.230624:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692417.230784:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108024832 00000100:00100000:2.0:1787692417.230798:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108024832 00000100:00100000:2.0:1787692417.230914:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:2.0:1787692417.230925:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+19:10327:x1874531108024832:12345-192.168.206.27@tcp:35:lfs.0 00000004:00010000:2.0:1787692417.231021:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de666 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b229e expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787692417.231656:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787692417.231719:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787692417.234022:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787692417.234136:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.234161:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de60b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2274 expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.234171:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.234220:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de60b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2274 expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.234238:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de60b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2274 expref: 23 pid: 8461 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692417.234255:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f47100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1874531125883648:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692417.234550:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec903eaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787692417.242215:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f47100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1874531125883648:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692417.242244:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692417.243271:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692417.245482:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108024960 00000100:00100000:1.0:1787692417.245504:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108024960 00010000:00010000:1.0:1787692417.245574:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de60b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2274 expref: 24 pid: 8461 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692417.245635:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:1.0:1787692417.245646:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+24:2362:x1874531108024960:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787692417.245665:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692417.245673:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de60b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2274 expref: 24 pid: 8461 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.245689:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de60b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2274 expref: 24 pid: 8461 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.245717:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de60b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2274 expref: 24 pid: 8461 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.245741:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636e00) 00010000:00010000:1.0:1787692417.245762:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.245773:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.245782:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.245965:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.245996:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.246108:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:2.0:1787692417.246141:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000100:00100000:1.0:1787692417.246211:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+24:2362:x1874531108024960:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 562us (2946us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692417.246229:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 37 00000001:00080000:2.0:1787692417.246351:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787692417.246482:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f47100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874531125883776:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787692417.246586:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692417.246861:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec903eaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787692417.250101:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125883776 00000100:00100000:1.0:1787692417.250123:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125883776 00000100:00100000:1.0:1787692417.250260:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787692417.250275:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874531125883776:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787692417.250506:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874531125883776:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 233us (3918us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692417.250515:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787692417.250952:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f47100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874531125883776:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1787692417.250990:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1787692417.252346:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787692417.253926:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f47100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874531125883904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787692417.254191:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692417.254230:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90905000 going to sleep for 11 seconds 00000100:00100000:1.0:1787692417.254651:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125883904 00000100:00100000:1.0:1787692417.254668:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125883904 00000100:00100000:1.0:1787692417.254750:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787692417.254764:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1874531125883904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787692417.255249:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1874531125883904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 486us (1056us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787692417.255259:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787692417.255560:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f47100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874531125883904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787692417.255656:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1787692417.255718:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.255731:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.255740:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.255746:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692417.255770:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.255780:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.255800:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636e00) 00010000:00010000:3.0:1787692417.255803:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787692417.255809:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.255842:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de67b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787692417.256079:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787692417.256586:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1787692417.256600:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 323462787026ns, next at 324462784078ns, rc = 0 00000001:00080000:3.0:1787692417.256609:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1787692417.256653:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636e00) 00010000:00010000:3.0:1787692417.256657:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787692417.256666:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de666 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b229e expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692417.256950:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+26:10327:x1874531108024832:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 26024us (26339us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1787692417.256961:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00000020:00080000:3.0:1787692417.256967:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787692417.263509:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692417.263574:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108025088 00000100:00100000:3.0:1787692417.263588:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108025088 00000100:00100000:3.0:1787692417.263653:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:3.0:1787692417.263664:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+26:10327:x1874531108025088:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1787692417.263702:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692417.263728:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de682 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b22a5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.263794:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de682 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22a5 expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.263847:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de682 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22a5 expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.263869:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692417.263873:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787692417.263877:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35a600, rc 0) 00000100:00100000:3.0:1787692417.263949:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+27:10327:x1874531108025088:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 287us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692417.263958:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:0.0:1787692417.267603:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692417.267683:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108025344 00000100:00100000:3.0:1787692417.267693:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108025344 00000100:00100000:3.0:1787692417.267754:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:3.0:1787692417.267766:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83551c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+27:10327:x1874531108025344:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1787692417.268468:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83551c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+28:10327:x1874531108025344:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 701us (870us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787692417.268478:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:0.0:1787692417.345330:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692417.345354:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125884032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692417.345436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692417.347490:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125884032 00000100:00100000:3.0:1787692417.347503:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125884032 00000100:00100000:3.0:1787692417.347570:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787692417.347582:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874531125884032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787692417.347608:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787692417.347693:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874531125884032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692417.347714:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787692417.347755:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125884032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692417.379567:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692417.379652:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108025600 00000100:00100000:2.0:1787692417.379661:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108025600 00000100:00100000:2.0:1787692417.379717:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:2.0:1787692417.379728:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+28:10337:x1874531108025600:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692417.379752:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692417.379771:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de689 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b22ac expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692417.379907:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787692417.380031:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de689 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22ac expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.380072:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a200) 00010000:00010000:2.0:1787692417.380075:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787692417.380082:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de689 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22ac expref: 30 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.380095:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3600, rc 0) 00000100:00100000:2.0:1787692417.380151:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+29:10337:x1874531108025600:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 425us (593us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787692417.380158:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:0.0:1787692417.385131:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692417.385416:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108025728 00000100:00100000:2.0:1787692417.385434:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108025728 00000100:00100000:2.0:1787692417.385496:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:2.0:1787692417.385507:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+29:10337:x1874531108025728:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:2.0:1787692417.385581:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de697 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385597:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de697 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385609:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de697 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385624:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de69e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385630:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de69e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385652:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de69e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385748:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385756:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385763:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787692417.385799:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385810:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de697 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385835:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de697 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385841:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de697 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385846:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692417.385850:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de697 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385857:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de697 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385867:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:2.0:1787692417.385875:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692417.385879:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de697 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385885:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de697 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385896:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de69e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385902:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de69e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385907:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de69e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385912:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692417.385914:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de69e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385919:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de69e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385925:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec94636000) 00010000:00010000:2.0:1787692417.385927:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692417.385929:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de69e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385933:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de69e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385945:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385955:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385960:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385965:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692417.385968:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385973:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.385978:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:2.0:1787692417.385980:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692417.385994:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.386000:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692417.386242:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+29:10337:x1874531108025728:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 735us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692417.386251:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:0.0:1787692417.389248:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692417.389332:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108025984 00000100:00100000:2.0:1787692417.389342:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108025984 00000100:00100000:2.0:1787692417.389406:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:2.0:1787692417.389416:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+29:10337:x1874531108025984:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1787692417.389686:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+30:10337:x1874531108025984:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 271us (447us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787692417.389708:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:0.0:1787692417.440757:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692417.440869:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108026240 00000100:00100000:3.0:1787692417.440878:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108026240 00000100:00100000:3.0:1787692417.440936:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:3.0:1787692417.440945:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+30:10340:x1874531108026240:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1787692417.440967:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692417.441006:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de6ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b22b3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441078:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de6b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441090:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441100:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441116:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de6ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441123:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de6ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441129:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de6ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441248:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de6c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441257:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441276:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692417.441286:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787692417.441374:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de6b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441381:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de6b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441401:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de6b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441407:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692417.441411:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de6b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441427:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de6b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441440:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:3.0:1787692417.441443:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692417.441447:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de6b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441453:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de6b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441465:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de6ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441470:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de6ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441483:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de6ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441488:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35ae00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692417.441492:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de6ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441498:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de6ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441507:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec9459a900) 00010000:00010000:3.0:1787692417.441509:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692417.441512:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de6ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441517:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de6ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441560:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de6ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22b3 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441572:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22b3 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.441580:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692417.441582:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787692417.441584:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec80031600, rc 0) 00000100:00100000:3.0:1787692417.441646:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+32:10340:x1874531108026240:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 701us (898us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1787692417.441663:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:1.0:1787692417.445710:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692417.446482:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108026368 00000100:00100000:3.0:1787692417.446493:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108026368 00000100:00100000:3.0:1787692417.446593:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:3.0:1787692417.446618:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+32:10340:x1874531108026368:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:3.0:1787692417.446690:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de6cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.446712:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de6cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.446723:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de6cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.446750:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de6cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.446757:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de6cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.446764:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de6cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.446769:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692417.446774:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de6cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.446782:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de6cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.446794:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692417.447178:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787692417.447185:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de6cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.447193:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de6cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692417.447274:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+32:10340:x1874531108026368:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 671us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692417.447282:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:0.0:1787692417.449793:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692417.449981:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108026624 00000100:00100000:2.0:1787692417.449991:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108026624 00000100:00100000:0.0:1787692417.450067:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:0.0:1787692417.450079:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+32:10340:x1874531108026624:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1787692417.450362:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+33:10340:x1874531108026624:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 285us (576us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787692417.450371:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00010000:00010000:1.0:1787692417.537067:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692417.709583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692417.709765:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108026880 00000100:00100000:2.0:1787692417.709775:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108026880 00000100:00100000:2.0:1787692417.709865:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:2.0:1787692417.709875:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+33:10371:x1874531108026880:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:2.0:1787692417.709899:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692417.709931:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b22ba expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.710023:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de6dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.710037:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.710048:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692417.710058:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787692417.710398:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22ba expref: 36 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.710483:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de6dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22ba expref: 35 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.710492:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:2.0:1787692417.710508:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692417.710511:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2200, rc 0) 00000100:00100000:2.0:1787692417.710649:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+35:10371:x1874531108026880:12345-192.168.206.27@tcp:101:cat.0 Request processed in 764us (1065us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787692417.710659:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:1.0:1787692417.723546:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692417.724223:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108027136 00000100:00100000:2.0:1787692417.724234:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108027136 00000100:00100000:2.0:1787692417.724353:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:2.0:1787692417.724370:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+35:10371:x1874531108027136:12345-192.168.206.27@tcp:35:cat.0 00000100:00100000:2.0:1787692417.724621:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+36:10371:x1874531108027136:12345-192.168.206.27@tcp:35:cat.0 Request processed in 252us (1084us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1787692417.724629:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:3.0:1787692417.730099:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692417.730574:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108027264 00000100:00100000:0.0:1787692417.730708:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108027264 00000100:00100000:0.0:1787692417.730772:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:0.0:1787692417.730983:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+36:2364:x1874531108027264:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692417.731001:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692417.731025:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de6dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22ba expref: 36 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.731273:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:0.0:1787692417.731279:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692417.731397:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+35:2364:x1874531108027264:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 615us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692417.731405:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:1.0:1787692417.802622:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692417.803336:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108027520 00000100:00100000:2.0:1787692417.803347:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108027520 00000100:00100000:2.0:1787692417.803593:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:2.0:1787692417.803604:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+35:10377:x1874531108027520:12345-192.168.206.27@tcp:101:dd.0 00010000:00010000:2.0:1787692417.803627:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692417.803630:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787692417.803657:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de643 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2290 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.803675:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:2.0:1787692417.803680:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787692417.803693:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b22c1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.803784:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.803810:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de6c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22b3 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.804036:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.804068:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22b3 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.804080:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22b3 expref: 35 pid: 5831 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692417.804093:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f44000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125884160:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692417.804181:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90905240 going to sleep for 11 seconds 00000100:00100000:1.0:1787692417.808378:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692417.808676:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108027648 00000100:00100000:0.0:1787692417.808687:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108027648 00010000:00010000:0.0:1787692417.808725:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de6c1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22b3 expref: 36 pid: 5831 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692417.808766:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:0.0:1787692417.808777:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+36:2362:x1874531108027648:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692417.808791:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692417.808799:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de6c1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22b3 expref: 36 pid: 5831 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.808850:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22b3 expref: 36 pid: 5831 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.808875:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:0.0:1787692417.808891:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.808902:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.808909:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692417.808929:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692417.808984:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+36:2362:x1874531108027648:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 209us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692417.808992:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 38 00010000:00010000:2.0:1787692417.809644:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de6c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22b3 expref: 35 pid: 5831 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692417.809664:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f44000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125884160:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692417.809685:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.809693:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.809699:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692417.809718:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787692417.809912:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de6eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22c1 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.809927:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22c1 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692417.809935:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:2.0:1787692417.809938:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787692417.809940:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3600, rc 0) 00000100:00100000:2.0:1787692417.809976:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+35:10377:x1874531108027520:12345-192.168.206.27@tcp:101:dd.0 Request processed in 6375us (7364us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1787692417.809996:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:1.0:1787692417.818325:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692417.818410:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108027904 00000100:00100000:3.0:1787692417.818430:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108027904 00000100:00100000:3.0:1787692417.818481:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:3.0:1787692417.818492:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+35:10377:x1874531108027904:12345-192.168.206.27@tcp:36:dd.0 00010000:00010000:3.0:1787692417.818749:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de700 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.818765:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de700 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692417.818777:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de700 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787692417.818917:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787692417.818943:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003c9dabbf reply state 00000000af66ea12 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de700 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692417.818954:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787692417.820505:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+38:10377:x1874531108027904:12345-192.168.206.27@tcp:36:dd.0 Request processed in 2003us (2177us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787692417.820536:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 52 00000020:00080000:3.0:1787692417.820544:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787692417.828270:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de700 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.828289:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de700 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.828297:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de700 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.828304:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692417.828309:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de700 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.828316:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de700 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.828333:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:1.0:1787692417.828337:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692417.828342:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de700 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692417.828348:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de700 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692418.116755:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692418.116840:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108028032 00000100:00100000:3.0:1787692418.116850:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108028032 00000100:00100000:3.0:1787692418.116936:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:3.0:1787692418.116948:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+37:10391:x1874531108028032:12345-192.168.206.27@tcp:101:stat.0 00010000:00010000:3.0:1787692418.116970:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692418.116988:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de707 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b22c8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.117052:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de70e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.117065:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de70e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.117076:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de70e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.117091:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.117099:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.117106:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.117197:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de71c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.117225:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22c1 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.117232:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de71c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.117265:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22c1 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.117279:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22c1 expref: 38 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692418.117292:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874531125884288:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692418.117403:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8b0fa840 going to sleep for 11 seconds 00000100:00080000:0.0:1787692418.117634:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692418.120611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692418.120683:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108028288 00000100:00100000:2.0:1787692418.120694:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108028288 00000100:00100000:3.0:1787692418.120727:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874531125884288:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692418.120754:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de71c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692418.120754:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:2.0:1787692418.120763:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+39:5598:x1874531108028288:12345-192.168.206.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787692418.121135:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+40:5598:x1874531108028288:12345-192.168.206.27@tcp:35:ldlm_bl.0 Request processed in 370us (532us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1787692418.121142:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:2.0:1787692418.123652:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692418.123964:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108028416 00000100:00100000:3.0:1787692418.123973:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108028416 00010000:00010000:3.0:1787692418.124088:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22c1 expref: 40 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692418.124178:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:3.0:1787692418.124189:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+40:2361:x1874531108028416:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692418.124203:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692418.124223:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22c1 expref: 40 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.124235:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22c1 expref: 40 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.124259:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09de6f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22c1 expref: 40 pid: 5832 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.124277:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692418.124282:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de71c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.124291:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de71c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.124298:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de71c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.124328:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692418.124726:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+39:2361:x1874531108028416:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 536us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692418.124735:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 39 00010000:00010000:2.0:1787692418.124795:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de71c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.124802:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de71c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692418.124866:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787692418.124871:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692418.124923:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de71c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.124937:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de71c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.124946:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de70e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.124952:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de70e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.124959:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de70e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.124965:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692418.124969:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de70e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.124976:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de70e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.124998:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:2.0:1787692418.125001:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692418.125004:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de70e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.125011:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de70e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.125023:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.125029:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de715 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.125042:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.125047:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692418.125050:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.125056:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de715 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.125065:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec9459a900) 00010000:00010000:2.0:1787692418.125068:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692418.125071:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de715 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.125076:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de715 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.125116:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de707 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22c8 expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.125131:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de71c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22c8 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.125139:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:2.0:1787692418.125141:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692418.125143:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec80031600, rc 0) 00000100:00100000:2.0:1787692418.125174:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+38:10391:x1874531108028032:12345-192.168.206.27@tcp:101:stat.0 Request processed in 8229us (8430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692418.125190:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:1.0:1787692418.192274:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692418.193751:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108028672 00000100:00100000:2.0:1787692418.193764:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108028672 00000100:00100000:2.0:1787692418.193920:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 54 00000100:00100000:2.0:1787692418.193932:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+38:10397:x1874531108028672:12345-192.168.206.27@tcp:36:truncate.0 00010000:00010000:2.0:1787692418.194081:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692418.194106:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de71c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22c8 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.194127:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:2.0:1787692418.194132:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787692418.194316:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de723 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.194331:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.194340:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787692418.194386:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1787692418.194697:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000417ef55c reply state 000000003367a64c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692418.194707:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787692418.195042:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+40:10397:x1874531108028672:12345-192.168.206.27@tcp:36:truncate.0 Request processed in 1110us (2775us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787692418.195051:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 54 00000020:00080000:2.0:1787692418.195062:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787692418.200578:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.200595:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de723 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.200604:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.200611:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692418.200616:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.200629:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de723 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.200646:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:2.0:1787692418.200650:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692418.200655:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de723 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.200660:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09de723 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692418.334489:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692418.334619:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108028800 00000100:00100000:3.0:1787692418.334628:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108028800 00000100:00100000:3.0:1787692418.334687:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:3.0:1787692418.334699:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+39:10411:x1874531108028800:12345-192.168.206.27@tcp:101:stat.0 00010000:00010000:3.0:1787692418.334724:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692418.334745:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de72a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b22cf expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.334865:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de731 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.334880:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de731 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.334890:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de731 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.334903:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de738 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.334909:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.334927:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335024:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de73f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335033:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335040:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692418.335075:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787692418.335079:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787692418.335100:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335122:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de73f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335130:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de731 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335136:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de731 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335143:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de731 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335149:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692418.335153:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de731 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335161:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de731 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335173:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:3.0:1787692418.335176:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692418.335180:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de731 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335604:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de731 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335621:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335628:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de738 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335642:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335647:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692418.335650:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335657:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de738 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335666:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec9459a600) 00010000:00010000:3.0:1787692418.335668:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692418.335672:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de738 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335678:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de738 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335721:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de72a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22cf expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335735:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de73f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22cf expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.335741:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692418.335743:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787692418.335745:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec80031e00, rc 0) 00000100:00100000:3.0:1787692418.335949:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+40:10411:x1874531108028800:12345-192.168.206.27@tcp:101:stat.0 Request processed in 1252us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692418.335968:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:1.0:1787692418.465313:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692418.465648:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108029056 00000100:00100000:2.0:1787692418.465658:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108029056 00000100:00100000:2.0:1787692418.465767:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:2.0:1787692418.465779:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+40:10421:x1874531108029056:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692418.465800:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692418.465861:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de746 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b22d6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692418.466003:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787692418.466130:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de746 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22d6 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.466145:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a200) 00010000:00010000:2.0:1787692418.466148:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787692418.466153:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de746 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22d6 expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.466166:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2800, rc 0) 00000100:00100000:2.0:1787692418.466219:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+41:10421:x1874531108029056:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 444us (916us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787692418.466227:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:2.0:1787692418.472733:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692418.472865:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108029312 00000100:00100000:0.0:1787692418.472876:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108029312 00000100:00100000:0.0:1787692418.472927:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:0.0:1787692418.472937:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+41:10421:x1874531108029312:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1787692418.473193:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+42:10421:x1874531108029312:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 257us (468us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1787692418.473202:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:1.0:1787692418.535284:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692418.535701:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108029568 00000100:00100000:0.0:1787692418.535713:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108029568 00000100:00100000:0.0:1787692418.535775:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:0.0:1787692418.535784:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+42:10427:x1874531108029568:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1787692418.535807:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692418.535858:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de754 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b22dd expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.536052:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.536070:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de73f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22cf expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.536078:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.536111:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de73f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22cf expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.536124:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de73f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22cf expref: 43 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692418.536138:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca6499880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125884416:192.168.206.27@tcp:104: 00000100:00100000:0.0:1787692418.536238:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec84ddf240 going to sleep for 11 seconds 00000100:00100000:2.0:1787692418.538229:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca6499880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125884416:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692418.538259:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692418.540200:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692418.540801:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108029696 00000100:00100000:0.0:1787692418.540835:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108029696 00010000:00010000:0.0:1787692418.540877:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de73f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22cf expref: 44 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692418.540918:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:0.0:1787692418.540927:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+44:2361:x1874531108029696:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692418.540940:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692418.540947:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de73f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22cf expref: 44 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.540971:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de73f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22cf expref: 44 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.540993:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de73f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22cf expref: 44 pid: 5833 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.541010:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:0.0:1787692418.541015:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.541024:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.541031:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.541069:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692418.541129:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+43:2361:x1874531108029696:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 202us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692418.541137:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 40 00010000:00010000:2.0:1787692418.541516:0:8461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.541525:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692418.541555:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787692418.542522:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de754 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22dd expref: 44 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.542760:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22dd expref: 43 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.542769:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:2.0:1787692418.542772:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787692418.542774:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6424200, rc 0) 00000100:00100000:2.0:1787692418.542855:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+43:10427:x1874531108029568:12345-192.168.206.27@tcp:101:bash.0 Request processed in 7072us (7581us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787692418.542864:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:1.0:1787692418.545480:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692418.545698:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108029952 00000100:00100000:0.0:1787692418.545709:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108029952 00000100:00100000:0.0:1787692418.545807:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00100000:0.0:1787692418.546709:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+43:10427:x1874531108029952:12345-192.168.206.27@tcp:36:bash.0 00010000:00010000:0.0:1787692418.547250:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de769 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.547266:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.547283:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787692418.547325:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787692418.547346:0:8193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000176a1b9f reply state 00000000f3ddf12a transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692418.547354:0:8193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787692418.547491:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+46:10427:x1874531108029952:12345-192.168.206.27@tcp:36:bash.0 Request processed in 799us (2017us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787692418.547499:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 58 00000020:00080000:0.0:1787692418.547505:0:8193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787692418.549804:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de769 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.549899:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de769 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.549907:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de769 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.549913:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692418.549918:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de769 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.549926:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de769 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.549941:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:1.0:1787692418.549944:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692418.549949:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de769 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.549954:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de769 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692418.553279:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692418.553366:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108030080 00000100:00100000:2.0:1787692418.553562:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108030080 00000100:00100000:2.0:1787692418.553619:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:2.0:1787692418.553629:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+45:10427:x1874531108030080:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1787692418.553652:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692418.553672:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de770 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b22e4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.553750:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de777 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.553765:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22dd expref: 46 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.553774:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de777 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.553924:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22dd expref: 46 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.553952:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22dd expref: 46 pid: 8461 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692418.553965:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874531125884544:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692418.554154:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec89cd5840 going to sleep for 11 seconds 00000100:00100000:0.0:1787692418.557354:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692418.557393:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874531125884544:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692418.557431:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de777 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692418.557497:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108030208 00000100:00100000:3.0:1787692418.557506:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108030208 00010000:00010000:3.0:1787692418.557542:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22dd expref: 47 pid: 8461 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692418.557621:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:3.0:1787692418.557630:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6499500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+47:2362:x1874531108030208:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692418.557644:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692418.557652:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22dd expref: 47 pid: 8461 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.557664:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22dd expref: 47 pid: 8461 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.557690:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de75b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22dd expref: 47 pid: 8461 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.557713:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692418.557718:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de777 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.557727:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.557734:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de777 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.557775:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692418.557865:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6499500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+46:2362:x1874531108030208:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 236us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692418.557874:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 41 00010000:00010000:0.0:1787692418.557929:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.557936:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692418.557982:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787692418.557986:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692418.558006:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de777 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.558710:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de770 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22e4 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.558731:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de777 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22e4 expref: 45 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.558753:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:0.0:1787692418.558756:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692418.558759:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3800, rc 0) 00000100:00100000:0.0:1787692418.558993:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+45:10427:x1874531108030080:12345-192.168.206.27@tcp:101:bash.0 Request processed in 5358us (5716us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692418.559001:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 59 00010000:00010000:2.0:1787692418.562113:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692418.564178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692418.564280:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108030464 00000100:00100000:2.0:1787692418.564289:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108030464 00000100:00100000:2.0:1787692418.564527:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:2.0:1787692418.564595:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83552450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+45:10427:x1874531108030464:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:2.0:1787692418.565182:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83552450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+46:10427:x1874531108030464:12345-192.168.206.27@tcp:35:bash.0 Request processed in 588us (1008us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787692418.565190:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:3.0:1787692418.667931:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692418.668088:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108030720 00000100:00100000:2.0:1787692418.668098:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108030720 00000100:00100000:2.0:1787692418.668205:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:2.0:1787692418.668216:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+46:10437:x1874531108030720:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692418.668240:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692418.668262:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de77e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b22eb expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692418.668865:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787692418.668997:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de77e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22eb expref: 48 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.669012:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a200) 00010000:00010000:2.0:1787692418.669014:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787692418.669019:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de77e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22eb expref: 48 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.669032:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2a00, rc 0) 00000100:00100000:2.0:1787692418.669094:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+47:10437:x1874531108030720:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 879us (1171us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787692418.669102:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:1.0:1787692418.672516:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692418.672610:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108030848 00000100:00100000:0.0:1787692418.672620:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108030848 00000100:00100000:0.0:1787692418.672686:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:0.0:1787692418.672696:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+47:10437:x1874531108030848:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:0.0:1787692418.672771:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de78c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.672807:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de78c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.672841:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de78c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.672859:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de793 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.672866:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.672873:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.672996:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de79a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673006:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de79a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673013:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de79a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787692418.673055:0:8193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de79a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673067:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de78c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673073:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de78c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673080:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de78c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673086:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692418.673090:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de78c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673097:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de78c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673111:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:0.0:1787692418.673114:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692418.673119:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de78c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673133:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de78c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673147:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673153:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de793 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673159:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673163:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692418.673167:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673173:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de793 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673180:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec832f4000) 00010000:00010000:0.0:1787692418.673183:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692418.673186:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de793 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673192:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de793 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673207:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de79a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673213:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de79a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673224:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de79a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673229:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692418.673232:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de79a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673238:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de79a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673246:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:0.0:1787692418.673249:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692418.673251:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de79a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.673257:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de79a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692418.673333:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+47:10437:x1874531108030848:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 637us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692418.673341:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:0.0:1787692418.682223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692418.682297:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108031104 00000100:00100000:2.0:1787692418.682307:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108031104 00000100:00100000:2.0:1787692418.682362:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:2.0:1787692418.682372:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+47:10437:x1874531108031104:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1787692418.682630:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+48:10437:x1874531108031104:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 258us (415us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787692418.682638:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:3.0:1787692418.745805:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692418.748075:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108031360 00000100:00100000:1.0:1787692418.748101:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108031360 00000100:00100000:1.0:1787692418.748183:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 62 00000100:00100000:1.0:1787692418.748210:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+48:10440:x1874531108031360:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692418.748240:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692418.748264:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09de7a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b22f2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.748344:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.748359:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.748370:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.748386:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de7af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.748393:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de7af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.748399:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de7af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.748532:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de7b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.748542:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.748548:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de7b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692418.748571:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787692418.749251:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749261:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749267:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749273:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692418.749278:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749285:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749297:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:1.0:1787692418.749299:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692418.749303:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749308:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749319:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de7af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749326:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de7af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749343:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de7af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749348:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692418.749350:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de7af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749355:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de7af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749361:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec9dbfa600) 00010000:00010000:1.0:1787692418.749363:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692418.749366:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de7af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749370:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de7af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749420:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09de7a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22f2 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749434:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de7b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22f2 expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.749441:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:1.0:1787692418.749443:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787692418.749445:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164c00, rc 0) 00000100:00100000:1.0:1787692418.749555:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+50:10440:x1874531108031360:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1349us (3759us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787692418.749571:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 62 00000100:00100000:1.0:1787692418.755850:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692418.755888:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692418.755961:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108031488 00000100:00100000:2.0:1787692418.755970:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108031488 00000100:00100000:2.0:1787692418.756029:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:2.0:1787692418.756039:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+50:10440:x1874531108031488:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:2.0:1787692418.756111:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de7c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.756140:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.756152:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.756187:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.756195:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de7c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.756202:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.756208:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692418.756212:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.756219:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de7c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.756231:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:2.0:1787692418.756234:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787692418.756238:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de7c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.756244:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09de7c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692418.756315:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+50:10440:x1874531108031488:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 277us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692418.756328:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:0.0:1787692418.757873:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108031616 00000100:00100000:0.0:1787692418.757887:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108031616 00000100:00100000:0.0:1787692418.757948:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:0.0:1787692418.757957:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+50:2364:x1874531108031616:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692418.757972:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692418.757993:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09de7b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22f2 expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.758027:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:0.0:1787692418.758031:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692418.758501:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+49:2364:x1874531108031616:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 128us (2195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692418.758511:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:1.0:1787692418.771983:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692418.772083:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108031872 00000100:00100000:2.0:1787692418.772093:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108031872 00000100:00100000:2.0:1787692418.772200:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:2.0:1787692418.772217:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+49:10440:x1874531108031872:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1787692418.772450:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+50:10440:x1874531108031872:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 241us (475us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787692418.772458:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:2.0:1787692418.949706:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692418.949834:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108032128 00000100:00100000:0.0:1787692418.949843:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108032128 00000100:00100000:0.0:1787692418.949901:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:0.0:1787692418.949912:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+50:10458:x1874531108032128:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:0.0:1787692418.949933:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692418.949953:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de7cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b22f9 expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.950047:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de7d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.950060:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.950073:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692418.950083:0:8193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787692418.950200:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de7cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22f9 expref: 53 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.950218:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de7d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22f9 expref: 52 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692418.950237:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:0.0:1787692418.950240:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787692418.950243:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425e00, rc 0) 00000100:00100000:0.0:1787692418.950303:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+52:10458:x1874531108032128:12345-192.168.206.27@tcp:101:cat.0 Request processed in 393us (605us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787692418.950310:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:3.0:1787692418.980876:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692418.981007:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108032256 00000100:00100000:1.0:1787692418.981017:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108032256 00000100:00100000:1.0:1787692418.981072:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 65 00000100:00100000:1.0:1787692418.981082:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+52:10459:x1874531108032256:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692418.981105:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692418.981126:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de7e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2300 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.981211:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.981226:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.981237:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692418.981296:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787692418.981300:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692418.981321:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.981347:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09de7e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2300 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.981782:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2300 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692418.981793:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:1.0:1787692418.981796:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787692418.981800:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165e00, rc 0) 00000100:00100000:1.0:1787692418.981915:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+53:10459:x1874531108032256:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 833us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692418.981923:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 65 00000100:00100000:1.0:1787692418.986266:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692418.986358:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108032640 00000100:00100000:0.0:1787692418.986369:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108032640 00000100:00100000:0.0:1787692418.986441:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:0.0:1787692418.986451:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+53:10459:x1874531108032640:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1787692418.986782:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+54:10459:x1874531108032640:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 325us (519us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1787692418.986790:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:2.0:1787692418.993602:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692418.993763:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108032768 00000100:00100000:3.0:1787692418.993773:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108032768 00000100:00100000:3.0:1787692418.993874:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:3.0:1787692418.993885:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+54:10459:x1874531108032768:12345-192.168.206.27@tcp:103:lfs.0 00010000:00010000:3.0:1787692418.993900:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787692418.993924:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de777 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22e4 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.993946:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de7d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22f9 expref: 53 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.993959:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de682 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b22a5 expref: 52 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692418.993969:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692418.993980:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692418.994049:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+51:10459:x1874531108032768:12345-192.168.206.27@tcp:103:lfs.0 Request processed in 166us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692418.994057:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:3.0:1787692418.995710:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692418.998105:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108032896 00000100:00100000:2.0:1787692418.998119:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108032896 00000100:00100000:2.0:1787692418.998220:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 66 00000100:00100000:2.0:1787692418.998231:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+51:10459:x1874531108032896:12345-192.168.206.27@tcp:58:lfs.0 00010000:00010000:2.0:1787692418.998370:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de7ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.998387:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de7ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692418.998398:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de7ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787692418.998956:0:8461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787692418.999766:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787692418.999866:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787692419.000009:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+51:10459:x1874531108032896:12345-192.168.206.27@tcp:58:lfs.0 Request processed in 1775us (4300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692419.000029:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 66 00000040:00080000:0.0:1787692419.010363:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787692419.010372:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787692419.010445:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787692419.010451:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787692419.010572:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca6498000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874531125884672:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787692419.010743:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec89cb19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692419.021554:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692419.021671:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108033024 00000100:00100000:1.0:1787692419.021681:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108033024 00000100:00100000:1.0:1787692419.021737:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:1.0:1787692419.021748:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:067f46f5-4779-40e6-b53d-5b3e89751501+52:10463:x1874531108033024:12345-192.168.206.27@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787692419.021872:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:067f46f5-4779-40e6-b53d-5b3e89751501+52:10463:x1874531108033024:12345-192.168.206.27@tcp:900:lhsmtool_posix.0 Request processed in 125us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692419.021880:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:2.0:1787692419.025903:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692419.026668:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108033152 00000100:00100000:3.0:1787692419.026678:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108033152 00000100:00100000:3.0:1787692419.026737:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 67 00000100:00100000:3.0:1787692419.026746:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+52:10463:x1874531108033152:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787692419.026775:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787692419.026907:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+52:10463:x1874531108033152:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 161us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692419.026914:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 67 00000100:00100000:3.0:1787692419.026973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692419.027682:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca6498000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874531125884672:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787692419.030842:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108033280 00000100:00100000:1.0:1787692419.030856:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108033280 00000100:00100000:1.0:1787692419.030922:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:1.0:1787692419.030934:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+51:10461:x1874531108033280:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692419.030956:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692419.031131:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09de7f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2307 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031222:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de7fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031236:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de7fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031247:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de7fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031262:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031269:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031276:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031369:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09de80a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031501:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09de80a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031511:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09de80a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692419.031546:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787692419.031550:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692419.031569:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09de80a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031593:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09de80a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031602:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de7fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031609:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de7fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031616:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de7fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031622:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692419.031625:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de7fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031633:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de7fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031644:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:1.0:1787692419.031648:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692419.031652:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de7fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031659:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de7fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031673:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031679:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de803 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031692:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031697:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692419.031700:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031706:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de803 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031715:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec9dbfa600) 00010000:00010000:1.0:1787692419.031717:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692419.031720:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de803 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031726:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de803 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031762:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09de7f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2307 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031775:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09de80a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2307 expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.031783:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636000) 00010000:00010000:1.0:1787692419.031786:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787692419.031788:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165800, rc 0) 00000100:00100000:1.0:1787692419.031905:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+52:10461:x1874531108033280:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 972us (4931us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692419.031922:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:3.0:1787692419.032341:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692419.032370:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108033408 00000100:00100000:3.0:1787692419.032398:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108033408 00000100:00100000:3.0:1787692419.032447:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:3.0:1787692419.032456:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+52:10463:x1874531108033408:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787692419.032497:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de811 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.032507:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de811 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.032515:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de811 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.037969:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de818 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038156:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de818 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038168:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de818 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038202:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de81f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038209:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de81f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038215:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de81f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692419.038252:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787692419.038256:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692419.038271:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de81f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038282:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de811 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038288:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de811 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038294:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de811 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038311:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692419.038315:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de811 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038322:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de811 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038334:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec832f4e00) 00010000:00010000:2.0:1787692419.038336:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692419.038340:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de811 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038345:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de811 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038359:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de818 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038364:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de818 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038370:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de818 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038374:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692419.038453:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de818 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038460:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de818 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038479:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff92ec94636800) 00010000:00010000:2.0:1787692419.038482:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692419.038485:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de818 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038490:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de818 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038506:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de81f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038511:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de81f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038516:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de81f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038519:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692419.038521:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de81f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038526:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de81f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038531:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636000) 00010000:00010000:2.0:1787692419.038532:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692419.038535:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de81f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.038540:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de81f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692419.038654:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+52:10463:x1874531108033408:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 Request processed in 6195us (6311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692419.038664:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:3.0:1787692419.040927:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692419.041118:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108033664 00000100:00100000:1.0:1787692419.041126:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108033664 00000100:00100000:1.0:1787692419.041171:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:1.0:1787692419.041179:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+52:10463:x1874531108033664:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787692419.041203:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692419.041222:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09de826 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b230e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.041309:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de82d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.041328:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.041339:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692419.041350:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787692419.041513:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de82d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.041521:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de82d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.041527:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de82d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.041531:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692419.041535:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de82d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.041554:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de82d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.041566:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636000) 00010000:00010000:1.0:1787692419.041569:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787692419.041573:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de82d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.041578:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de82d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.041622:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09de826 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b230e expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.041631:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec832f4e00) 00010000:00010000:1.0:1787692419.041633:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787692419.041637:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09de826 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b230e expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.041645:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164000, rc 0) 00000100:00100000:1.0:1787692419.041747:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+53:10463:x1874531108033664:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 567us (827us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1787692419.041754:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:0.0:1787692419.044896:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692419.045140:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108033792 00000100:00100000:3.0:1787692419.045150:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108033792 00000100:00100000:3.0:1787692419.045242:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 71 00000100:00100000:3.0:1787692419.045266:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+53:10463:x1874531108033792:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787692419.045306:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787692419.045444:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6498000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+53:10463:x1874531108033792:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 181us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692419.045453:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 71 00000100:00100000:2.0:1787692419.048735:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692419.048900:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108034048 00000100:00100000:0.0:1787692419.048909:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108034048 00000100:00100000:0.0:1787692419.048958:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 72 00000100:00100000:0.0:1787692419.048967:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+53:10463:x1874531108034048:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787692419.049114:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692419.049117:0:8461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787692419.049142:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de7e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2300 expref: 53 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.049159:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:0.0:1787692419.049163:0:8461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787692419.049176:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425200/0x5d8b8560a09de83b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2315 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787692419.049718:0:8461:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787692419.051367:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de842 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.051499:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.051512:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.051584:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425200/0x5d8b8560a09de83b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2315 expref: 55 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.051604:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2315 expref: 54 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.051614:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ec832f4000) 00010000:00010000:0.0:1787692419.051617:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692419.051631:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6424e00, rc 0) 00000100:00100000:0.0:1787692419.051698:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+54:10463:x1874531108034048:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 2731us (2971us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1787692419.051707:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 72 00000100:00100000:0.0:1787692419.054631:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692419.061111:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108034304 00000100:00100000:1.0:1787692419.061126:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108034304 00000100:00100000:1.0:1787692419.061191:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 73 00000100:00100000:1.0:1787692419.061202:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+54:10463:x1874531108034304:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787692419.061280:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692419.061310:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de842 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2315 expref: 54 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.061330:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ec832f4000) 00010000:00010000:1.0:1787692419.061341:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787692419.061365:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de850 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.061378:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de850 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.061388:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de850 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.061710:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de857 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9892953f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.061718:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9892953f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.061726:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9892953f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.061795:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de850 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.061802:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de850 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.061809:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de850 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.062141:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692419.062145:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de850 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.062152:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de850 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.062162:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:1.0:1787692419.062165:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692419.062169:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de850 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.062174:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de850 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.062185:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de857 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9892953f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.062190:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de857 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9892953f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.062195:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de857 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9892953f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.062200:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692419.062202:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de857 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9892953f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.062207:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de857 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9892953f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.062223:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9892953f (ffff92ec9dbfa600) 00010000:00010000:1.0:1787692419.062225:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692419.062228:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de857 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9892953f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.062234:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de857 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9892953f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692419.062371:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6498380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+53:10463:x1874531108034304:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 1168us (7748us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787692419.062379:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 73 00000100:00100000:1.0:1787692419.082474:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692419.082556:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108034432 00000100:00100000:3.0:1787692419.082566:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108034432 00000100:00100000:3.0:1787692419.082639:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:3.0:1787692419.082651:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+53:10463:x1874531108034432:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787692419.082676:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692419.082701:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de85e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b231c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.082738:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.082752:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.082763:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.082934:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de85e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b231c expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.082957:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b231c expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.082977:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692419.082980:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787692419.082984:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec80031000, rc 0) 00000100:00100000:3.0:1787692419.083044:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+54:10463:x1874531108034432:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 396us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692419.083051:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:2.0:1787692419.090672:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692419.091145:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108034688 00000100:00100000:0.0:1787692419.091156:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108034688 00000100:00100000:0.0:1787692419.091218:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:0.0:1787692419.091229:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+54:10463:x1874531108034688:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787692419.091315:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de86c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.091332:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de86c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.091344:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de86c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787692419.091669:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1787692419.091680:0:8461:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325297867104ns, next at 326297864200ns, rc = 0 00000004:00010000:0.0:1787692419.091766:0:8461:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057847a43 reply state 00000000fcab343d transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de86c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692419.091776:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787692419.092079:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+56:10463:x1874531108034688:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 850us (1417us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1787692419.092087:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:1.0:1787692419.098708:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692419.098873:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108034816 00000100:00100000:3.0:1787692419.098882:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108034816 00000100:00100000:3.0:1787692419.099007:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 76 00000100:00100000:3.0:1787692419.099018:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+56:10463:x1874531108034816:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787692419.099041:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692419.099061:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de873 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2323 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.099118:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de873 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2323 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.099132:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de873 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2323 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.099151:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692419.099154:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787692419.099157:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec80030a00, rc 0) 00000100:00100000:3.0:1787692419.099217:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+57:10463:x1874531108034816:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 201us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692419.099240:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 76 00010000:00010000:2.0:1787692419.100010:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de86c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.100021:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de86c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.100028:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de86c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.100034:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692419.100039:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de86c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.100047:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de86c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.100059:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:2.0:1787692419.100062:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787692419.100066:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de86c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.100073:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de86c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692419.102745:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692419.102864:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108034944 00000100:00100000:2.0:1787692419.102884:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108034944 00000100:00100000:2.0:1787692419.102922:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:2.0:1787692419.102930:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1874531108034944:12345-192.168.206.27@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787692419.102963:0:6679:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp t0 exp 0000000000000000 cur 325 last 0 00000020:00000080:2.0:1787692419.103006:0:6679:0:(genops.c:1385:class_connect()) connect: client 067f46f5-4779-40e6-b53d-5b3e89751501, cookie 0x5d8b8560a09de87a 00002000:00100000:2.0:1787692419.103018:0:6679:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 067f46f5-4779-40e6-b53d-5b3e89751501/ffff92ecc561e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787692419.103042:0:6679:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787692419.103256:0:6679:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787692419.103298:0:6679:0:(import.c:65:import_set_state_nolock()) ffff92ec88171000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787692419.103372:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6498e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2360:x1874531108034944:12345-192.168.206.27@tcp:8:lhsmtool_posix.0 Request processed in 441us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692419.103380:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:1.0:1787692419.117530:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692419.117646:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108035072 00000100:00100000:0.0:1787692419.117666:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108035072 00000100:00100000:0.0:1787692419.117754:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:0.0:1787692419.117764:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:0:x1874531108035072:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787692419.118279:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787692419.195317:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:0:x1874531108035072:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 77543us (77783us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787692419.195329:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 25 00000001:00080000:1.0:1787692419.197583:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1787692419.197605:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 067f46f5-4779-40e6-b53d-5b3e89751501 00000100:00100000:1.0:1787692419.205199:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692419.209560:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108035328 00000100:00100000:2.0:1787692419.209574:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108035328 00000100:00100000:3.0:1787692419.209715:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:3.0:1787692419.209727:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+56:10463:x1874531108035328:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787692419.211147:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+57:10463:x1874531108035328:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 1414us (5949us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1787692419.211160:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:0.0:1787692419.216890:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692419.217203:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108035584 00000100:00100000:2.0:1787692419.217214:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108035584 00000100:00100000:2.0:1787692419.217273:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 77 00000100:00100000:2.0:1787692419.217283:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+57:10463:x1874531108035584:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787692419.217402:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6498700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+57:10463:x1874531108035584:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 119us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692419.217420:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 77 00000100:00100000:0.0:1787692419.225480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692419.225605:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108035712 00000100:00100000:3.0:1787692419.225615:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108035712 00000100:00100000:3.0:1787692419.225672:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 78 00000100:00100000:3.0:1787692419.225682:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+57:10463:x1874531108035712:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787692419.225699:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692419.225717:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de881 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b232a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.225779:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.225792:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.225802:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692419.225861:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787692419.225881:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.225936:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09de881 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b232a expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.225953:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b232a expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.225962:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692419.225965:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787692419.225969:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec80031e00, rc 0) 00000100:00100000:3.0:1787692419.226022:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+58:10463:x1874531108035712:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 342us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692419.226028:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 78 00000100:00100000:3.0:1787692419.229691:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692419.229771:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108035840 00000100:00100000:2.0:1787692419.229782:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108035840 00000100:00100000:2.0:1787692419.229864:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:2.0:1787692419.229874:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531108035840:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692419.229890:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692419.229921:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09de88f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2331 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787692419.229957:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8e0582, blocks: 0x1 00010000:00010000:2.0:1787692419.229976:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=325s v=(0 0) 00010000:00010000:2.0:1787692419.229980:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692419.229990:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09de88f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2331 expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.230009:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09de88f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2331 expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.230023:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3a00, rc 0) 00000100:00100000:2.0:1787692419.230076:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108035840:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 204us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692419.230083:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:3.0:1787692419.232642:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692419.232727:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108036096 00000100:00100000:2.0:1787692419.232737:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108036096 00000100:00100000:2.0:1787692419.232842:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:2.0:1787692419.232851:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+58:10463:x1874531108036096:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787692419.232956:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+58:10463:x1874531108036096:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 106us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692419.232964:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:3.0:1787692419.241049:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692419.241349:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108036224 00000100:00100000:1.0:1787692419.241361:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108036224 00000100:00100000:1.0:1787692419.241452:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:1.0:1787692419.241463:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:10463:x1874531108036224:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787692419.241483:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692419.241503:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09de896 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2338 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.241539:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09de88f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2331 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.241550:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692419.241554:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692419.241560:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09de896 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2338 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.241591:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09de88f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2331 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.241605:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09de88f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2331 expref: 7 pid: 6679 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692419.241619:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf71c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6680:1874531125884800:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692419.241704:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787692419.243680:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692419.243777:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108036352 00000100:00100000:0.0:1787692419.243786:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108036352 00010000:00010000:0.0:1787692419.243857:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09de88f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2331 expref: 8 pid: 6679 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692419.243901:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:0.0:1787692419.243910:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+8:2361:x1874531108036352:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692419.243923:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692419.243953:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09de88f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2331 expref: 8 pid: 6679 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.243967:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09de88f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2331 expref: 8 pid: 6679 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.243998:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692419.244004:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692419.244011:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09de896 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2338 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.244021:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09de896 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2338 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.244075:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09de896 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2338 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692419.244089:0:5817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca6499f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1874531125884928:192.168.206.27@tcp:105: 00000100:00100000:0.0:1787692419.244159:0:5817:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec89cb13c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787692419.245119:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09de88f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2331 expref: 8 pid: 6679 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692419.245139:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf71c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6680:1874531125884800:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692419.245166:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09de896 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2338 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.245179:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164800, rc 0) 00000100:00100000:1.0:1787692419.245243:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf923800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:10463:x1874531108036224:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 3781us (4203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692419.245251:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:2.0:1787692419.252000:0:5817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca6499f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1874531125884928:192.168.206.27@tcp:105: 00010000:00010000:2.0:1787692419.252027:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692419.252085:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108036352:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 8174us (8412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692419.252107:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:3.0:1787692419.259383:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692419.259481:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108036480 00000100:00100000:1.0:1787692419.259491:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108036480 00002000:00100000:1.0:1787692419.259536:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff92ecaf922300 x1874531108036480/t0(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:410/0 lens 504/0 e 0 to 0 dl 1787692430 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787692419.259547:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecaf922300 with x1874531108036480 ext(0->8) 00002000:00010000:1.0:1787692419.259553:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecaf922300 00000100:00100000:1.0:1787692419.259583:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:1.0:1787692419.259593:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108036480:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787692419.260294:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf922300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:067f46f5-4779-40e6-b53d-5b3e89751501+8:2362:x1874531108036480:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 Request processed in 700us (929us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787692419.260304:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00002000:00100000:1.0:1787692419.260312:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff92ecaf922300 x1874531108036480/t4294967302(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:410/0 lens 504/448 e 0 to 0 dl 1787692430 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787692419.260321:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecaf922300 with x1874531108036480 ext(0->8) 00002000:00010000:1.0:1787692419.260326:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecaf922300 00000100:00100000:3.0:1787692419.268447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692419.268539:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108036608 00000100:00100000:0.0:1787692419.268547:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108036608 00000100:00100000:0.0:1787692419.268604:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00100000:0.0:1787692419.268614:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+58:10463:x1874531108036608:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787692419.322076:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf920a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+58:10463:x1874531108036608:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 Request processed in 53454us (53628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692419.322089:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 80 00000001:00080000:3.0:1787692419.322124:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1787692419.322129:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787692419.322194:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92ec903eaf00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787692419.322198:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ecaf189d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92ec903eacc0 00000020:00080000:3.0:1787692419.322202:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ecaf189500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92ec880ec400 00000001:00080000:3.0:1787692419.322235:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1787692419.322247:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787692419.322759:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125885056:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787692419.322833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692419.322927:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125885056 00000100:00100000:2.0:1787692419.322935:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125885056 00000100:00100000:2.0:1787692419.322984:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787692419.322993:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874531125885056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787692419.323017:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1787692419.323047:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8e0580, atime: 0x6a8e0580, ctime: 0x6a8e0580, blocks: 0xb 00010000:00010000:2.0:1787692419.323055:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09de89d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.323070:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=325s v=(0 0) 00010000:00010000:2.0:1787692419.323075:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692419.323082:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09de89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.323096:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09de89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.323105:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09de89d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.323114:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09de89d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.323132:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787692419.324264:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692419.324864:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1874531125885056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1868us (2027us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787692419.324884:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787692419.324907:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108036736 00000100:00100000:2.0:1787692419.324914:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108036736 00000100:00100000:2.0:1787692419.324953:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:2.0:1787692419.324961:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+8:2362:x1874531108036736:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787692419.325125:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125885184:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787692419.325166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787692419.325214:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787692419.325225:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125885184 00000100:00100000:2.0:1787692419.325229:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125885184 00000100:00100000:2.0:1787692419.325259:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787692419.325264:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125885184:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1787692419.325501:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92ec91f44000/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787692419.325507:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125885056:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1787692419.325719:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1787692419.325807:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:0.0:1787692419.325905:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692419.325913:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09de89d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.325924:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2a00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692419.325929:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09de89d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.325939:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09de89d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787692419.326132:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787692419.326136:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787692418 00002000:00010000:2.0:1787692419.326138:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787692419.326141:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787692418 -> 1787692418 00002000:00010000:2.0:1787692419.326143:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787692419.326401:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874531125885184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1133us (1230us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787692419.326418:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1787692419.326577:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09de89d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.326588:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09de89d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.326610:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692419.326612:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692419.326614:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787692419.326873:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1787692419.330725:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92ecaf922d80/2, rc 0, transno 4294967303 00000100:00100000:1.0:1787692419.330740:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125885184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787692419.386237:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+8:2362:x1874531108036736:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 Request processed in 61266us (61968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692419.386251:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 29 00000001:00080000:1.0:1787692419.386337:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1787692419.386352:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1787692419.389258:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692419.389511:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108036992 00000100:00100000:0.0:1787692419.389521:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108036992 00000100:00100000:0.0:1787692419.389619:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 81 00000100:00100000:0.0:1787692419.389631:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+13:10463:x1874531108036992:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787692419.389682:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692419.389708:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09de888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b232a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.389728:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:0.0:1787692419.389733:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787692419.389759:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de8a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.389788:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de8a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.389798:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de8a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787692419.393692:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7062dca reply state 000000005bbdd7a5 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de8a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692419.393708:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787692419.393864:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf922680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+14:10463:x1874531108036992:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 4231us (4610us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787692419.393888:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 81 00010000:00010000:3.0:1787692419.395575:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de8a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.395590:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de8a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.395597:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de8a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.395603:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692419.395608:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de8a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.395617:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de8a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.395633:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692419.395636:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692419.395641:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de8a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.395646:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de8a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692419.397330:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692419.398125:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108037120 00000100:00100000:1.0:1787692419.398136:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108037120 00000100:00100000:1.0:1787692419.398194:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:1.0:1787692419.398217:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108037120:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787692419.398471:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787692419.398475:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787692418 -> 1787692418 00002000:00010000:1.0:1787692419.398478:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787692416 00002000:00010000:1.0:1787692419.398480:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787692418 -> 1787692418 00002000:00010000:1.0:1787692419.398482:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787692419.398544:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf923100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2362:x1874531108037120:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 329us (1223us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787692419.398552:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:1.0:1787692419.400792:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692419.400908:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108037376 00000100:00100000:2.0:1787692419.400918:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108037376 00000100:00100000:2.0:1787692419.400984:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:2.0:1787692419.400995:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+13:10463:x1874531108037376:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787692419.401066:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.401081:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de865 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b231c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.401090:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.401126:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b231c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.401139:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de865 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b231c expref: 13 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692419.401153:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125885312:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692419.401235:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec877669c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692419.405872:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692419.406254:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108037504 00000100:00100000:3.0:1787692419.406274:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108037504 00010000:00010000:3.0:1787692419.406311:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de865 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b231c expref: 14 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692419.406356:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:3.0:1787692419.406364:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+14:2361:x1874531108037504:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692419.406376:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692419.406398:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de865 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b231c expref: 14 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.406418:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de865 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b231c expref: 14 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.406438:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692419.406442:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.406451:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.406457:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.406474:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692419.406520:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+14:2361:x1874531108037504:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 156us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692419.406527:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 43 00010000:00010000:2.0:1787692419.413231:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de865 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b231c expref: 13 pid: 5832 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692419.413258:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f47b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125885312:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692419.413298:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.413309:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.413315:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.413350:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.413356:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.413362:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.413368:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692419.413371:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.413378:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.413393:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:2.0:1787692419.413396:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787692419.413400:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.413418:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692419.413618:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+12:10463:x1874531108037376:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 Request processed in 12623us (12832us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787692419.413628:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:1.0:1787692419.431891:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692419.432027:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108037632 00000100:00100000:2.0:1787692419.432038:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108037632 00000100:00100000:2.0:1787692419.432093:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00100000:2.0:1787692419.432103:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108037632:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787692419.432147:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.432168:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09de896 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2338 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.432176:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692419.432181:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787692419.432185:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.432218:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09de896 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2338 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.432233:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09de896 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2338 expref: 7 pid: 6680 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692419.432247:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1874531125885440:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692419.432334:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec877669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692419.434146:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1874531125885440:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692419.434173:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692419.443256:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692419.443554:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108037760 00000100:00100000:2.0:1787692419.443564:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108037760 00010000:00010000:2.0:1787692419.443604:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09de896 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2338 expref: 8 pid: 6680 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692419.443642:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:2.0:1787692419.443652:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+8:2362:x1874531108037760:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692419.443665:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692419.443689:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09de896 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2338 expref: 8 pid: 6680 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.443705:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09de896 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2338 expref: 8 pid: 6680 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.443728:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09de896 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2338 expref: 8 pid: 6680 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.443742:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787692419.443746:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787692419.443752:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.443774:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.443799:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692419.443877:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:2362:x1874531108037760:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 227us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692419.443885:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 44 00010000:00010000:2.0:1787692419.443908:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.443917:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.443940:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.443948:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.443955:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.443962:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692419.443967:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.443987:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.443999:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.444007:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09de8b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692419.444055:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108037632:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 Request processed in 11954us (12172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692419.444063:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00100000:1.0:1787692419.452134:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692419.452234:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108038016 00000100:00100000:3.0:1787692419.452244:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108038016 00000100:00100000:3.0:1787692419.452309:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 83 00000100:00100000:3.0:1787692419.452319:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+12:10463:x1874531108038016:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787692419.452537:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de8b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.452553:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.452563:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.453513:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.453528:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de873 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2323 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.453535:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.453569:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de873 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2323 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.453583:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de873 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2323 expref: 13 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692419.453595:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf921880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125885568:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692419.453681:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a000 going to sleep for 11 seconds 00000100:00100000:1.0:1787692419.456661:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692419.456750:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108038144 00000100:00100000:0.0:1787692419.456760:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108038144 00010000:00010000:0.0:1787692419.456798:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de873 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2323 expref: 14 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692419.456852:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:0.0:1787692419.456862:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+14:2362:x1874531108038144:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692419.456874:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692419.456880:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de873 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2323 expref: 14 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.456893:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de873 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2323 expref: 14 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.456913:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:0.0:1787692419.456918:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.456935:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.456942:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692419.456970:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692419.457142:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+14:2362:x1874531108038144:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 281us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692419.457149:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 45 00010000:00010000:3.0:1787692419.458788:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de873 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2323 expref: 13 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692419.458867:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf921880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125885568:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692419.458890:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.458900:0:8461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.458906:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787692419.460170:0:8461:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1787692419.460316:0:8461:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787692419.460362:0:8461:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1787692419.460468:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf921880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8461:1874531125885696:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787692419.460527:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692419.460553:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787692419.461089:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125885696 00000100:00100000:1.0:1787692419.461097:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125885696 00000100:00100000:1.0:1787692419.461155:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787692419.461164:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8461:x1874531125885696:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787692419.461243:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8461:x1874531125885696:12345-0@lo:1000:mdt00_004.0 Request processed in 80us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692419.461251:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787692419.461479:0:8461:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787692419.461486:0:8461:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92ecaf922d80, transno 4294967303 00000100:00100000:3.0:1787692419.461506:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf921880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8461:1874531125885696:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787692419.463325:0:8461:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787692419.464139:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf921880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8461:1874531125885824:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787692419.464201:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692419.464234:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a000 going to sleep for 11 seconds 00000100:00100000:1.0:1787692419.464331:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125885824 00000100:00100000:1.0:1787692419.464338:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125885824 00000100:00100000:1.0:1787692419.464396:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787692419.464414:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8461:x1874531125885824:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1787692419.464623:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8461:x1874531125885824:12345-0@lo:1000:mdt00_004.0 Request processed in 218us (420us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787692419.464631:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787692419.464788:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf921880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8461:1874531125885824:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1787692419.464899:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.464921:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.464928:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465154:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692419.465158:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465166:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465182:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692419.465185:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787692419.465190:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465196:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465228:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de7ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465234:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de7ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465240:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de7ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465245:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692419.465254:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de7ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465260:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de7ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465268:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636000) 00010000:00010000:3.0:1787692419.465271:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787692419.465274:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de7ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465280:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09de7ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465301:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465314:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09de80a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2307 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465323:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465352:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09de80a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2307 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.465365:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09de80a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2307 expref: 16 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692419.465389:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf920000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125885952:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692419.465460:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a000 going to sleep for 11 seconds 00000100:00100000:3.0:1787692419.467967:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf920000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125885952:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692419.468003:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692419.468686:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692419.468752:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108038272 00000100:00100000:2.0:1787692419.468759:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108038272 00010000:00010000:2.0:1787692419.468790:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09de80a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2307 expref: 17 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692419.468854:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:2.0:1787692419.468864:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf130700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+17:2361:x1874531108038272:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692419.468877:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692419.468884:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09de80a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2307 expref: 17 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.468894:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09de80a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2307 expref: 17 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.468933:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09de80a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2307 expref: 17 pid: 5833 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.468950:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636000) 00010000:00010000:2.0:1787692419.468954:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.468963:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.468970:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.469005:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692419.469051:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf130700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+16:2361:x1874531108038272:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 188us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692419.469057:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 46 00010000:00010000:1.0:1787692419.469185:0:8461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469192:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469204:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469210:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469216:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469221:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35ae00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692419.469225:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469231:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469240:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636000) 00010000:00010000:1.0:1787692419.469243:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692419.469246:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469252:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de8c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469268:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469275:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de8b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469281:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469285:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692419.469288:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469293:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de8b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469300:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636000) 00010000:00010000:1.0:1787692419.469302:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787692419.469304:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de8b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692419.469308:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de8b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692419.469513:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+15:10463:x1874531108038016:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 17194us (17544us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787692419.469522:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 83 00000020:00080000:1.0:1787692419.469526:0:8461:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787692419.469690:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787692419.469694:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787692419.469718:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787692419.469723:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787692419.479314:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692419.479738:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108038528 00000100:00100000:2.0:1787692419.479749:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108038528 00000100:00100000:2.0:1787692419.479802:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:2.0:1787692419.479832:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+15:10463:x1874531108038528:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787692419.480503:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787692419.480614:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787692419.480668:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.480682:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.480693:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.480700:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.480705:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.480710:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.480732:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787692419.480842:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+17:10463:x1874531108038528:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 1029us (1535us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787692419.480851:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00000020:00080000:2.0:1787692419.480855:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787692419.480880:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692419.480886:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.480893:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692419.480897:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.480904:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.480926:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff92ec94636800) 00010000:00010000:2.0:1787692419.480929:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787692419.480933:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ce lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.480940:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09de8ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.480957:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692419.480959:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692419.480961:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692419.587132:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787692419.820022:0:11991:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787692419.820031:0:11991:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787692419.820065:0:11991:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1787692419.820070:0:11991:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787692419.960885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692419.961014:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108038784 00000100:00100000:3.0:1787692419.961024:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108038784 00000100:00100000:3.0:1787692419.961081:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:3.0:1787692419.961092:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+17:10482:x1874531108038784:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1787692419.961113:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692419.961131:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de8d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b233f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.961377:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.961391:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.961402:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692419.961427:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787692419.961759:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de8d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b233f expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.961777:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b233f expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692419.961791:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:3.0:1787692419.961794:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787692419.961798:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35a600, rc 0) 00000100:00100000:3.0:1787692419.961880:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+19:10482:x1874531108038784:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 789us (1003us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1787692419.961888:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:1.0:1787692419.973201:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692419.973265:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108038912 00000100:00100000:2.0:1787692419.973274:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108038912 00000100:00100000:2.0:1787692419.973331:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:2.0:1787692419.973342:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+19:10482:x1874531108038912:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:2.0:1787692419.973418:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de8ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.973433:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de8ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.973444:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de8ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.973457:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de8f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.973464:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.973470:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974048:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de8f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974058:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974065:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787692419.974101:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974112:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de8ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974119:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de8ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974126:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de8ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974131:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692419.974135:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de8ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974141:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de8ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974152:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:2.0:1787692419.974156:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692419.974160:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de8ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974173:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09de8ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974187:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de8f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974192:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de8f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974198:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de8f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974203:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692419.974206:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de8f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974210:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de8f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974217:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec94636800) 00010000:00010000:2.0:1787692419.974220:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692419.974222:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de8f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974226:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09de8f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974240:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de8f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974246:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de8f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974257:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974261:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692419.974264:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de8f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974269:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de8f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974277:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec94636100) 00010000:00010000:2.0:1787692419.974279:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692419.974282:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de8f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692419.974287:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de8f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692419.974357:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+19:10482:x1874531108038912:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 1015us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692419.974365:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:3.0:1787692420.021018:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.021102:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108039168 00000100:00100000:0.0:1787692420.021111:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108039168 00000100:00100000:0.0:1787692420.021178:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00100000:0.0:1787692420.021189:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+19:10485:x1874531108039168:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692420.021207:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692420.021238:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425200/0x5d8b8560a09de8ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2346 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787692420.021301:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787692420.021307:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de906 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.021321:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.021331:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.021347:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de90d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.021354:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de90d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.021362:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de90d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.021686:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de914 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.021696:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.021703:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692420.021713:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787692420.021848:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de906 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.021856:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de906 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.021862:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de906 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.021867:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692420.021871:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de906 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.021877:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de906 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.021889:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:0.0:1787692420.021892:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692420.021897:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de906 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.022046:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de906 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.022058:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de90d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.022064:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de90d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.022079:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de90d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.022085:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692420.022088:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de90d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.022094:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de90d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.022103:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec832f4900) 00010000:00010000:0.0:1787692420.022105:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692420.022108:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de90d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.022114:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de90d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.022157:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425200/0x5d8b8560a09de8ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2346 expref: 22 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.022169:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2346 expref: 21 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.022183:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec832f4c00) 00010000:00010000:0.0:1787692420.022185:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692420.022187:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6424200, rc 0) 00000100:00100000:0.0:1787692420.022255:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+21:10485:x1874531108039168:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1067us (1246us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787692420.022263:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00100000:3.0:1787692420.028915:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692420.029015:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108039296 00000100:00100000:2.0:1787692420.029024:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108039296 00000100:00100000:2.0:1787692420.029080:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 87 00000100:00100000:2.0:1787692420.029089:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+21:10485:x1874531108039296:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:2.0:1787692420.029151:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de922 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.029168:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.029189:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.029217:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de922 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.029225:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de922 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.029232:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.029239:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692420.029244:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de922 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.029252:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de922 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.029264:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec832f4c00) 00010000:00010000:2.0:1787692420.029268:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787692420.029273:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de922 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.029279:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09de922 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692420.029355:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf920380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+21:10485:x1874531108039296:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 266us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692420.029365:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 87 00000100:00100000:3.0:1787692420.037205:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692420.037289:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108039552 00000100:00100000:2.0:1787692420.037309:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108039552 00000100:00100000:2.0:1787692420.037370:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:2.0:1787692420.037395:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83550850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+21:10485:x1874531108039552:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1787692420.037641:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83550850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+22:10485:x1874531108039552:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 248us (447us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787692420.037651:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:2.0:1787692420.061462:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692420.061863:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108039808 00000100:00100000:3.0:1787692420.061873:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108039808 00000100:00100000:3.0:1787692420.061936:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 88 00000100:00100000:3.0:1787692420.061946:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+22:10015:x1874531108039808:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:3.0:1787692420.061971:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692420.061990:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de929 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b234d expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.062099:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.062112:0:8193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de914 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2346 expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.062121:0:8193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.062170:0:8193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2346 expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.062183:0:8193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de914 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2346 expref: 23 pid: 8461 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692420.062198:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf920e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125886080:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692420.062287:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692420.068526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692420.068574:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108039936 00000100:00100000:1.0:1787692420.068583:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108039936 00010000:00010000:1.0:1787692420.068621:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de914 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2346 expref: 24 pid: 8461 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692420.068629:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf920e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125886080:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692420.068650:0:8193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692420.068659:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:1.0:1787692420.068667:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6499c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+24:2362:x1874531108039936:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787692420.068681:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692420.068696:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de914 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2346 expref: 24 pid: 8461 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.068707:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2346 expref: 24 pid: 8461 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.068728:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de914 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2346 expref: 24 pid: 8461 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.068742:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec832f4c00) 00010000:00010000:1.0:1787692420.068746:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.068766:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.068772:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.068799:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787692420.068831:0:8193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.068838:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692420.068856:0:8193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:1.0:1787692420.068882:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6499c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+23:2362:x1874531108039936:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 214us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692420.068890:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 47 00010000:00010000:3.0:1787692420.069009:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de929 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b234d expref: 24 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.069024:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b234d expref: 23 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.069031:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec832f4c00) 00010000:00010000:3.0:1787692420.069033:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787692420.069041:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35b600, rc 0) 00000100:00100000:3.0:1787692420.070888:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+23:10015:x1874531108039808:12345-192.168.206.27@tcp:101:bash.0 Request processed in 7126us (7618us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787692420.070908:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 88 00000100:00100000:1.0:1787692420.072102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.072687:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108040192 00000100:00100000:0.0:1787692420.072698:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108040192 00000100:00100000:0.0:1787692420.072758:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 89 00000100:00100000:0.0:1787692420.072768:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+23:10015:x1874531108040192:12345-192.168.206.27@tcp:36:bash.0 00010000:00010000:0.0:1787692420.073056:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de93e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.073319:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de93e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.073333:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de93e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787692420.073390:0:8461:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787692420.073432:0:8461:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a5f595c reply state 00000000286b9f23 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de93e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692420.073441:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787692420.073484:0:8461:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787692420.073687:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+27:10015:x1874531108040192:12345-192.168.206.27@tcp:36:bash.0 Request processed in 917us (1588us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787692420.073710:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 89 00000020:00080000:0.0:1787692420.073715:0:8461:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787692420.075948:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de93e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.075963:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de93e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.075970:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de93e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.075975:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692420.075980:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de93e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.075987:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de93e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.076003:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec832f4c00) 00010000:00010000:0.0:1787692420.076009:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787692420.076012:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00010000:00010000:0.0:1787692420.076015:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de93e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.076021:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de93e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692420.076627:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108040320 00000100:00100000:3.0:1787692420.076640:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108040320 00000100:00100000:3.0:1787692420.076704:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 90 00000100:00100000:3.0:1787692420.076719:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+26:10015:x1874531108040320:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:3.0:1787692420.076745:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692420.076766:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de945 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2354 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.076866:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de945 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2354 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.076880:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de945 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2354 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.076900:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec832f4c00) 00010000:00010000:3.0:1787692420.076902:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787692420.076905:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35ae00, rc 0) 00000100:00100000:3.0:1787692420.076959:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+27:10015:x1874531108040320:12345-192.168.206.27@tcp:101:bash.0 Request processed in 244us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692420.076966:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 90 00000100:00100000:3.0:1787692420.079903:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692420.080091:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108040448 00000100:00100000:1.0:1787692420.080100:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108040448 00000100:00100000:1.0:1787692420.080157:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:1.0:1787692420.080167:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:10015:x1874531108040448:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1787692420.080184:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692420.080205:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09de94c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b235b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787692420.080229:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8e0582, atime: 0x6a8e0580, ctime: 0x6a8e0582, blocks: 0xb 00010000:00010000:1.0:1787692420.080250:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1787692420.080255:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692420.080263:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09de94c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b235b expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.080285:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09de94c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b235b expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.080297:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165a00, rc 0) 00000100:00100000:1.0:1787692420.080361:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:10015:x1874531108040448:12345-192.168.206.27@tcp:101:bash.0 Request processed in 195us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692420.080368:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:1.0:1787692420.084609:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692420.084721:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108040576 00000100:00100000:2.0:1787692420.084731:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108040576 00002000:00010000:2.0:1787692420.084768:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1787692420.084772:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecaf133800 with x1874531108040576 ext(0->18446744073709551615) 00002000:00010000:2.0:1787692420.084784:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecaf133800. 00000100:00100000:2.0:1787692420.084841:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:2.0:1787692420.084852:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108040576:12345-192.168.206.27@tcp:10:bash.0 00002000:00010000:2.0:1787692420.085121:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787692420.085125:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787692418 -> 1787692419 00002000:00010000:2.0:1787692420.085127:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787692416 -> 1787692416 00002000:00010000:2.0:1787692420.085130:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787692418 -> 1787692419 00002000:00010000:2.0:1787692420.085132:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787692420.085191:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:067f46f5-4779-40e6-b53d-5b3e89751501+8:2361:x1874531108040576:12345-192.168.206.27@tcp:10:bash.0 Request processed in 340us (590us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787692420.085201:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00002000:00010000:2.0:1787692420.085205:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1787692420.085207:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecaf133800 with x1874531108040576 ext(0->18446744073709551615) 00002000:00010000:2.0:1787692420.085211:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecaf133800. 00000100:00100000:2.0:1787692420.151797:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692420.152110:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108040704 00000100:00100000:3.0:1787692420.152120:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108040704 00000100:00100000:3.0:1787692420.152212:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 91 00000100:00100000:3.0:1787692420.152236:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+27:10499:x1874531108040704:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:3.0:1787692420.152304:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de953 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152320:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152331:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152346:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de95a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152353:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152359:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152605:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de961 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152615:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152622:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787692420.152657:0:8193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152668:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152679:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de953 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152686:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de953 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152692:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692420.152696:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de953 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152703:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de953 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152714:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:3.0:1787692420.152717:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692420.152721:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de953 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152727:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09de953 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152738:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152744:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de95a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152750:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de95a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152755:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692420.152761:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de95a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152767:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de95a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152774:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec9459a700) 00010000:00010000:3.0:1787692420.152776:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692420.152779:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de95a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152784:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09de95a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152797:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152802:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de961 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152808:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152899:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692420.152902:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152908:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de961 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152924:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec832f4c00) 00010000:00010000:3.0:1787692420.152927:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692420.152936:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de961 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.152943:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09de961 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692420.153023:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+27:10499:x1874531108040704:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 788us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692420.153031:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 91 00000100:00100000:0.0:1787692420.211332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692420.211452:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108040960 00000100:00100000:1.0:1787692420.211462:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108040960 00000100:00100000:1.0:1787692420.211527:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 92 00000100:00100000:1.0:1787692420.211537:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+27:10502:x1874531108040960:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692420.211556:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692420.211576:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de968 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2362 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.211646:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de96f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.211661:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de96f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.211673:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de96f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.211688:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de976 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.211695:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.211702:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212074:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de97d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212084:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212102:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692420.212112:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787692420.212202:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de96f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212210:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de96f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212217:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de96f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212223:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692420.212228:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de96f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212234:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de96f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212246:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:1.0:1787692420.212249:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692420.212254:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de96f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212259:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de96f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212271:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212276:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de976 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212288:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212293:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692420.212295:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212301:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212309:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec9dbfa700) 00010000:00010000:1.0:1787692420.212311:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692420.212314:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de976 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212319:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de976 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212360:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09de968 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2362 expref: 30 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212375:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2362 expref: 29 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.212381:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec832f4c00) 00010000:00010000:1.0:1787692420.212383:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787692420.212385:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165200, rc 0) 00000100:00100000:1.0:1787692420.212459:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+29:10502:x1874531108040960:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 923us (1137us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787692420.212476:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 92 00000100:00100000:1.0:1787692420.222130:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.222239:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108041088 00000100:00100000:0.0:1787692420.222248:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108041088 00000100:00100000:0.0:1787692420.222313:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 93 00000100:00100000:0.0:1787692420.222323:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+29:10502:x1874531108041088:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:0.0:1787692420.222414:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.222430:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b234d expref: 29 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.222439:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.222471:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b234d expref: 29 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.222484:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b234d expref: 29 pid: 8193 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692420.222497:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874531125886208:192.168.206.27@tcp:104: 00000100:00100000:0.0:1787692420.222593:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787692420.224533:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874531125886208:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692420.224563:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692420.229629:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.229732:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108041344 00000100:00100000:0.0:1787692420.229741:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108041344 00000100:00100000:0.0:1787692420.229799:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:0.0:1787692420.229809:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+30:5598:x1874531108041344:12345-192.168.206.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787692420.230152:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+31:5598:x1874531108041344:12345-192.168.206.27@tcp:35:ldlm_bl.0 Request processed in 343us (531us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1787692420.230177:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:2.0:1787692420.232133:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.232442:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108041472 00000100:00100000:0.0:1787692420.232451:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108041472 00010000:00010000:0.0:1787692420.232656:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b234d expref: 31 pid: 8193 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692420.232745:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:0.0:1787692420.232755:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+31:2362:x1874531108041472:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692420.232770:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692420.232778:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b234d expref: 31 pid: 8193 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.232791:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b234d expref: 31 pid: 8193 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.232836:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09de930 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b234d expref: 31 pid: 8193 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.232851:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec832f4c00) 00010000:00010000:0.0:1787692420.232855:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.232864:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.232870:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.232930:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692420.232986:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+30:2362:x1874531108041472:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 232us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692420.232993:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 48 00010000:00010000:1.0:1787692420.233192:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.233201:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.233229:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.233236:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.233243:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.233248:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692420.233252:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.233260:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.233269:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec832f4c00) 00010000:00010000:1.0:1787692420.233272:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787692420.233275:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.233280:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de98b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692420.233346:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+29:10502:x1874531108041088:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 11025us (11226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692420.233354:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 93 00000100:00100000:2.0:1787692420.238389:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.238485:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108041728 00000100:00100000:0.0:1787692420.238495:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108041728 00000100:00100000:0.0:1787692420.238581:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:0.0:1787692420.238591:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+29:10502:x1874531108041728:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1787692420.238808:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+30:10502:x1874531108041728:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 218us (428us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787692420.239176:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:2.0:1787692420.255574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692420.255615:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692420.255663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692420.255752:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108041856 00000100:00100000:1.0:1787692420.255761:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108041856 00000100:00100000:1.0:1787692420.255808:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 280 00000100:00100000:1.0:1787692420.255840:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2361:x1874531108041856:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692420.255900:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2361:x1874531108041856:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 62us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692420.255907:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 280 00000100:00100000:0.0:1787692420.256161:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108041984 00000100:00100000:0.0:1787692420.256166:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108041984 00000100:00100000:0.0:1787692420.256219:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:0.0:1787692420.256228:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108041984:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692420.256262:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108041984:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 35us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692420.256268:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00080000:2.0:1787692420.256328:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787692420.256737:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108042112 00000100:00100000:3.0:1787692420.256742:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108042112 00000100:00100000:3.0:1787692420.256792:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 123 00000100:00100000:3.0:1787692420.256800:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2361:x1874531108042112:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692420.256871:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2361:x1874531108042112:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 72us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692420.256878:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 123 00000100:00080000:2.0:1787692420.256939:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692420.354235:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692420.354341:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108042368 00000100:00100000:1.0:1787692420.354350:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108042368 00000100:00100000:1.0:1787692420.354418:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 94 00000100:00100000:1.0:1787692420.354428:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+30:10513:x1874531108042368:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:1.0:1787692420.354456:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692420.354477:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de992 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2369 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.354549:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de999 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.354562:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de999 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.354573:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de999 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.354604:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.354612:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.354618:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.354957:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09de9a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.354967:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09de9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.354975:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09de9a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692420.354983:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787692420.355151:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de999 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355160:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de999 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355166:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de999 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355172:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692420.355176:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de999 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355195:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de999 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355207:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:1.0:1787692420.355210:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692420.355215:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de999 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355221:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de999 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355232:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355238:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355244:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355249:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692420.355252:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355258:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355265:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec9dbfa700) 00010000:00010000:1.0:1787692420.355267:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692420.355270:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355285:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355329:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de992 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2369 expref: 33 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355344:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09de9a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2369 expref: 32 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.355351:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec832f4c00) 00010000:00010000:1.0:1787692420.355353:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787692420.355356:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165c00, rc 0) 00000100:00100000:1.0:1787692420.355435:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+32:10513:x1874531108042368:12345-192.168.206.27@tcp:101:cat.0 Request processed in 1008us (1207us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787692420.355443:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 94 00000100:00100000:1.0:1787692420.364556:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692420.364675:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108042624 00000100:00100000:2.0:1787692420.364686:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108042624 00000100:00100000:2.0:1787692420.364745:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:2.0:1787692420.364756:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+32:10513:x1874531108042624:12345-192.168.206.27@tcp:35:cat.0 00000100:00100000:2.0:1787692420.365045:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+33:10513:x1874531108042624:12345-192.168.206.27@tcp:35:cat.0 Request processed in 289us (496us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787692420.365054:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:3.0:1787692420.384702:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692420.387463:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108042880 00000100:00100000:1.0:1787692420.387477:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108042880 00000100:00100000:1.0:1787692420.387914:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 95 00000100:00100000:1.0:1787692420.387926:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+33:10514:x1874531108042880:12345-192.168.206.27@tcp:36:rm.0 00010000:00010000:1.0:1787692420.388000:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787692420.388027:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09de9a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2369 expref: 33 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.388049:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09de97d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2362 expref: 32 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.388093:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09de945 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2354 expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.388104:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec832f4c00) 00010000:00010000:1.0:1787692420.388114:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787692420.388134:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.388146:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.388155:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.388169:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de9bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.388176:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de9bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.388182:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de9bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.394250:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de9c3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.394270:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de9c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.394281:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de9c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787692420.394984:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1787692420.394994:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 326601180403ns, next at 327601178038ns, rc = 0 00010000:00010000:1.0:1787692420.395065:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de9ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395076:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de9ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395084:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de9ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395090:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de9ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395096:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de9ca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395102:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de9ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395133:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787692420.395163:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de9c3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395170:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de9c3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395176:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de9c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395181:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692420.395192:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de9c3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395200:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de9c3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395212:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9dbfa000) 00010000:00010000:1.0:1787692420.395215:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787692420.395220:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de9c3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395227:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09de9c3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395244:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395250:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395256:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395261:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692420.395264:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395270:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395278:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:1.0:1787692420.395280:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692420.395289:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.395294:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09de9b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787692420.395306:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad9e5e7c reply state 00000000ca23d04b transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de9bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692420.395314:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787692420.395394:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf920700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+32:10514:x1874531108042880:12345-192.168.206.27@tcp:36:rm.0 Request processed in 7468us (10707us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1787692420.395413:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 95 00010000:00010000:3.0:1787692420.396229:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692420.396237:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de9ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.396245:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165400 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692420.396248:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de9ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.396255:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de9ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.396265:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff92ec9dbfa000) 00010000:00010000:3.0:1787692420.396268:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787692420.396281:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de9ca lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.396287:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09de9ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.396305:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692420.396308:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692420.396310:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692420.398956:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de9bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.398971:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de9bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.398990:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de9bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.398996:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692420.399000:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de9bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.399008:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de9bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.399189:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec9dbfa700) 00010000:00010000:3.0:1787692420.399194:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692420.399199:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de9bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.399206:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09de9bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692420.441656:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.443474:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108043136 00000100:00100000:0.0:1787692420.443488:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108043136 00000100:00100000:0.0:1787692420.443680:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 96 00000100:00100000:0.0:1787692420.443690:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+31:10520:x1874531108043136:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1787692420.443711:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692420.443730:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de9d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2370 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.443893:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de9d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.443907:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de9d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.443927:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de9d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.443942:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de9df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.443948:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de9df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.443954:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de9df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787692420.444502:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787692420.444677:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de9e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.444686:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.444694:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de9e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.444724:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de9d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.444742:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de9d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.444748:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de9d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.444754:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692420.444758:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de9d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.444765:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de9d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.444776:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:0.0:1787692420.444779:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692420.444784:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de9d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.444790:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09de9d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787692420.444802:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f5323a7 reply state 00000000f2897c1a transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de9df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692420.444809:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787692420.444891:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09de9d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2370 expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.444904:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2370 expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.444922:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:0.0:1787692420.444924:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692420.444927:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6424200, rc 0) 00000100:00100000:0.0:1787692420.445007:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+34:10520:x1874531108043136:12345-192.168.206.27@tcp:101:bash.0 Request processed in 1318us (3359us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787692420.445014:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 96 00010000:00010000:2.0:1787692420.448292:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de9df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.448308:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de9df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.448315:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de9df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.448320:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692420.448325:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de9df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.448349:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de9df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.448365:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec832f4900) 00010000:00010000:2.0:1787692420.448368:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692420.448373:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de9df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.448380:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09de9df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692420.452056:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692420.452317:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108043264 00000100:00100000:1.0:1787692420.452328:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108043264 00000100:00100000:1.0:1787692420.452392:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:1.0:1787692420.452413:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+5:2363:x1874531108043264:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1787692420.452431:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692420.452452:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000990a9bbb/0x5d8b8560a09de9f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2377 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787692420.452477:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787692420.452494:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1787692420.452499:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692420.452508:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000990a9bbb/0x5d8b8560a09de9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2377 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.452703:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000990a9bbb/0x5d8b8560a09de9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2377 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.452734:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164200, rc 0) 00000100:00100000:1.0:1787692420.452805:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf921f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:2363:x1874531108043264:12345-192.168.206.27@tcp:101:bash.0 Request processed in 403us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692420.452840:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:3.0:1787692420.455601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.455803:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108043392 00000100:00100000:0.0:1787692420.455839:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108043392 00000100:00100000:0.0:1787692420.455890:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:0.0:1787692420.455900:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:10520:x1874531108043392:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1787692420.455917:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692420.455933:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b237e expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.455962:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000990a9bbb/0x5d8b8560a09de9f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2377 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.455981:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692420.455986:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692420.455992:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.456187:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000990a9bbb/0x5d8b8560a09de9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2377 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.456217:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000990a9bbb/0x5d8b8560a09de9f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2377 expref: 7 pid: 6680 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692420.456231:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874531125886336:192.168.206.27@tcp:104: 00000100:00100000:0.0:1787692420.456324:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787692420.461918:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6679:1874531125886336:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692420.461959:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 7 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.461980:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425200, rc 0) 00000100:00100000:3.0:1787692420.462039:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:10520:x1874531108043392:12345-192.168.206.27@tcp:101:bash.0 Request processed in 6140us (6446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692420.462048:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:3.0:1787692420.465956:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.466228:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108043520 00000100:00100000:0.0:1787692420.466238:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108043520 00010000:00010000:0.0:1787692420.466275:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000990a9bbb/0x5d8b8560a09de9f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2377 expref: 7 pid: 6680 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692420.466317:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:0.0:1787692420.466327:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108043520:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692420.466341:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692420.466362:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000990a9bbb/0x5d8b8560a09de9f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2377 expref: 7 pid: 6680 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.466376:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000990a9bbb/0x5d8b8560a09de9f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2377 expref: 7 pid: 6680 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.466397:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000990a9bbb/0x5d8b8560a09de9f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2377 expref: 7 pid: 6680 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.466423:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692420.466440:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692420.466448:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.466458:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.466493:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692420.466507:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca6498a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1874531125886464:192.168.206.27@tcp:105: 00000100:00100000:0.0:1787692420.466586:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfc0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692420.473168:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.473336:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca6498a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1874531125886464:192.168.206.27@tcp:105: 00010000:00010000:0.0:1787692420.473368:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692420.473439:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108043520:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 7112us (7490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692420.473450:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:3.0:1787692420.475786:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108043776 00000100:00100000:3.0:1787692420.475798:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108043776 00000100:00100000:3.0:1787692420.475861:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:3.0:1787692420.475870:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+33:10520:x1874531108043776:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:3.0:1787692420.476249:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+34:10520:x1874531108043776:12345-192.168.206.27@tcp:35:bash.0 Request processed in 377us (3088us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787692420.476257:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 25 00010000:00010000:0.0:1787692420.608983:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692420.648240:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.650156:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108043904 00000100:00100000:0.0:1787692420.650169:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108043904 00000100:00100000:0.0:1787692420.650305:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 97 00000100:00100000:0.0:1787692420.650317:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+34:10536:x1874531108043904:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692420.650342:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692420.650362:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09dea02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2385 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.650442:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09dea09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.650469:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09dea09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.650480:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09dea09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692420.650549:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787692420.650553:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692420.650576:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09dea09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.650618:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09dea02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2385 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.650636:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09dea09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2385 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.650645:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:0.0:1787692420.650647:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787692420.650651:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425c00, rc 0) 00000100:00100000:0.0:1787692420.650720:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+35:10536:x1874531108043904:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 405us (2488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692420.650732:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 97 00000100:00100000:2.0:1787692420.657102:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692420.657267:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108044160 00000100:00100000:1.0:1787692420.657278:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108044160 00000100:00100000:1.0:1787692420.657338:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 98 00000100:00100000:1.0:1787692420.657349:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+35:10536:x1874531108044160:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692420.657376:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692420.657396:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09dea10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b238c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.657496:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dea17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.657725:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dea17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.657741:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dea17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692420.657753:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787692420.657948:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09dea10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b238c expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.657965:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dea17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b238c expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.657989:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:1.0:1787692420.657992:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787692420.657996:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165200, rc 0) 00000100:00100000:1.0:1787692420.658217:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+37:10536:x1874531108044160:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 868us (1125us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787692420.658224:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 98 00000100:00100000:2.0:1787692420.665139:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.665287:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108044416 00000100:00100000:0.0:1787692420.665296:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108044416 00000100:00100000:0.0:1787692420.665352:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00100000:0.0:1787692420.665361:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+37:10536:x1874531108044416:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692420.665394:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692420.665436:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09dea25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2393 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.665542:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09dea2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.665557:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09dea2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.665567:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09dea2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692420.665580:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787692420.665721:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424e00/0x5d8b8560a09dea25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2393 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.665739:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09dea2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2393 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.665747:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:0.0:1787692420.665750:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787692420.665753:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92eca6425e00, rc 0) 00000100:00100000:0.0:1787692420.666998:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf678380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+39:10536:x1874531108044416:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1630us (1861us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787692420.667009:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00100000:2.0:1787692420.669903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692420.670020:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108044544 00000100:00100000:3.0:1787692420.670105:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108044544 00000100:00100000:3.0:1787692420.670170:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:3.0:1787692420.670180:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+39:2364:x1874531108044544:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692420.670194:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692420.670232:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dea17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b238c expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.670251:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:3.0:1787692420.670256:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692420.670662:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf678e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+38:2364:x1874531108044544:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 483us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692420.670671:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:1.0:1787692420.679977:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.680190:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108044672 00000100:00100000:0.0:1787692420.680200:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108044672 00000100:00100000:0.0:1787692420.680258:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:0.0:1787692420.680268:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:2364:x1874531108044672:12345-192.168.206.27@tcp:1:lfs.0 00010000:00010000:0.0:1787692420.680322:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.680343:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.680352:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692420.680356:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787692420.680360:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.680394:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 6 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.680420:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 6 pid: 6679 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692420.680434:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca6499c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874531125886592:192.168.206.27@tcp:104: 00000100:00100000:0.0:1787692420.680545:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787692420.688006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.688120:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca6499c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874531125886592:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692420.688148:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692420.688364:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108044800 00000100:00100000:3.0:1787692420.688447:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108044800 00002000:00100000:3.0:1787692420.688493:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff92ecaf132680 x1874531108044800/t0(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:411/0 lens 504/0 e 0 to 0 dl 1787692431 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787692420.688502:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecaf132680 with x1874531108044800 ext(0->8) 00010000:00010000:3.0:1787692420.688508:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 7 pid: 6679 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.688522:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 7 pid: 6679 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787692420.688531:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ecaf132680 00000100:00100000:3.0:1787692420.688626:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:3.0:1787692420.688636:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108044800:12345-192.168.206.27@tcp:4:lfs.0 00000100:00100000:3.0:1787692420.689110:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:067f46f5-4779-40e6-b53d-5b3e89751501+9:2361:x1874531108044800:12345-192.168.206.27@tcp:4:lfs.0 Request processed in 474us (1111us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787692420.689118:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00002000:00100000:3.0:1787692420.689126:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff92ecaf132680 x1874531108044800/t4294967302(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:411/0 lens 504/448 e 0 to 0 dl 1787692431 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787692420.689140:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecaf132680 with x1874531108044800 ext(0->8) 00010000:00010000:3.0:1787692420.689148:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 9 pid: 6679 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.689171:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 9 pid: 6679 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787692420.689179:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ecaf132680 00000100:00100000:2.0:1787692420.692146:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692420.692307:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108044928 00000100:00100000:1.0:1787692420.692317:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108044928 00010000:00010000:1.0:1787692420.692351:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 9 pid: 6679 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692420.692408:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:1.0:1787692420.692418:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf678700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+9:2364:x1874531108044928:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787692420.692432:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787692420.692450:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787692420.692453:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787692420 00002000:00010000:1.0:1787692420.692455:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787692420 00002000:00010000:1.0:1787692420.692457:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787692420 00010000:00010000:1.0:1787692420.692463:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 9 pid: 6679 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.692476:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 9 pid: 6679 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.692514:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002050477a/0x5d8b8560a09de9fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b237e expref: 9 pid: 6679 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.692530:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787692420.692534:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787692420.692540:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.692550:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.692588:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692420.692651:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf678700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+8:2364:x1874531108044928:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 234us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692420.692658:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 50 00010000:00010000:2.0:1787692420.693131:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.693142:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.693176:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.693184:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.693204:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.693211:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424e00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692420.693215:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.693224:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.693237:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.693245:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c9f0e38/0x5d8b8560a09dea3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692420.693302:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2364:x1874531108044672:12345-192.168.206.27@tcp:1:lfs.0 Request processed in 13034us (13333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692420.693309:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:2.0:1787692420.697370:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692420.697507:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108045184 00000100:00100000:3.0:1787692420.697517:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108045184 00000100:00100000:3.0:1787692420.697574:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:3.0:1787692420.697587:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83551850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+38:10536:x1874531108045184:12345-192.168.206.27@tcp:35:lfs.0 00000004:00010000:3.0:1787692420.697654:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09dea2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2393 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787692420.697912:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787692420.697959:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787692420.698241:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787692420.698290:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.698320:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de9e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2370 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.698328:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.698379:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2370 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.698393:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de9e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2370 expref: 42 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692420.698419:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf921c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1874531125886720:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692420.698497:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a780 going to sleep for 11 seconds 00000100:00100000:3.0:1787692420.701436:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf921c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1874531125886720:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692420.701462:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692420.706799:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692420.707882:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108045312 00000100:00100000:3.0:1787692420.707893:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108045312 00010000:00010000:3.0:1787692420.707933:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de9e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2370 expref: 43 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692420.708076:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:3.0:1787692420.708087:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+43:2361:x1874531108045312:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692420.708104:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692420.708111:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de9e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2370 expref: 43 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.708124:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de9e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2370 expref: 43 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.708173:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424200/0x5d8b8560a09de9e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2370 expref: 43 pid: 5833 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.708190:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:3.0:1787692420.708195:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.708203:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.708210:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.708243:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692420.708297:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+42:2361:x1874531108045312:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 213us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692420.708305:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 51 00010000:00010000:2.0:1787692420.708439:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.708448:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787692420.708582:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1787692420.709096:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1787692420.709409:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf679f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874531125886848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787692420.709463:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692420.709556:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90a38e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787692420.709596:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125886848 00000100:00100000:1.0:1787692420.709602:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125886848 00000100:00100000:1.0:1787692420.709753:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787692420.709761:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5835:x1874531125886848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787692420.710121:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5835:x1874531125886848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 359us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692420.710128:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787692420.712504:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf679f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874531125886848:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787692420.713085:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1787692420.713175:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf679f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874531125886976:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787692420.713228:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692420.713252:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9144e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787692420.714013:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125886976 00000100:00100000:0.0:1787692420.714021:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125886976 00000100:00100000:0.0:1787692420.714073:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787692420.714092:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1874531125886976:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787692420.714305:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf679c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5835:x1874531125886976:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 215us (1077us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787692420.714313:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787692420.714507:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf679f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1874531125886976:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787692420.714563:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1787692420.714600:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.714610:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.714618:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.714634:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692420.714638:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.714646:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.714670:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:2.0:1787692420.714674:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787692420.714678:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.714684:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea41 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787692420.714886:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787692420.714992:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1787692420.715002:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326921188768ns, next at 327921186886ns, rc = 0 00000001:00080000:2.0:1787692420.715009:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1787692420.715037:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:2.0:1787692420.715040:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787692420.715047:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425e00/0x5d8b8560a09dea2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2393 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692420.715145:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83551850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+45:10536:x1874531108045184:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 17550us (17771us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1787692420.715154:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 26 00000020:00080000:2.0:1787692420.715158:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787692420.719326:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.719434:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108045440 00000100:00100000:0.0:1787692420.719444:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108045440 00000100:00100000:0.0:1787692420.719576:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 100 00000100:00100000:0.0:1787692420.719588:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+45:10536:x1874531108045440:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692420.719622:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692420.719645:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09dea48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b239a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.719701:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09dea48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b239a expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.719716:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09dea48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b239a expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.719733:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:0.0:1787692420.719736:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787692420.719740:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1000, rc 0) 00000100:00100000:0.0:1787692420.719797:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+46:10536:x1874531108045440:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 212us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692420.719805:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 100 00000100:00100000:0.0:1787692420.726549:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692420.726765:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108045696 00000100:00100000:2.0:1787692420.726775:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108045696 00000100:00100000:2.0:1787692420.726897:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:2.0:1787692420.726908:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+46:10536:x1874531108045696:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1787692420.727133:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6499c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+47:10536:x1874531108045696:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 226us (592us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787692420.727152:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:3.0:1787692420.812857:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692420.813001:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108045824 00000100:00100000:1.0:1787692420.813010:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108045824 00000100:00100000:0.0:1787692420.813116:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 101 00000100:00100000:0.0:1787692420.813129:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+47:10546:x1874531108045824:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:0.0:1787692420.813213:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dea4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813229:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dea4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813240:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dea4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813253:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dea56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813259:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dea56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813265:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dea56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813348:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813355:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813361:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787692420.813464:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813477:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dea4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813491:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dea4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813498:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dea4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813503:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692420.813507:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dea4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813513:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dea4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813523:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:0.0:1787692420.813526:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692420.813529:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dea4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813535:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dea4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813546:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dea56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813550:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dea56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813555:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dea56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813559:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692420.813567:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dea56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813572:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dea56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813578:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec832f4b00) 00010000:00010000:0.0:1787692420.813580:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692420.813583:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dea56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813588:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dea56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813600:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813604:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813609:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813614:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692420.813616:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813621:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813625:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:0.0:1787692420.813627:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692420.813634:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.813639:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692420.813781:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf921c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+47:10546:x1874531108045824:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 655us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692420.813789:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 101 00000100:00100000:0.0:1787692420.843964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692420.844173:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108046080 00000100:00100000:3.0:1787692420.844182:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108046080 00000100:00100000:3.0:1787692420.844245:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 102 00000100:00100000:3.0:1787692420.844256:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+47:10549:x1874531108046080:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1787692420.844275:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692420.844295:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dea64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23a1 expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.844365:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dea6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.844459:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dea6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.844471:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dea6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.844488:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.844494:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.844501:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.844618:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.844627:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.844634:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692420.844643:0:8193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787692420.845567:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dea6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.845578:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dea6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.845585:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dea6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.845599:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692420.845604:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dea6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.845611:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dea6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.845624:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:3.0:1787692420.845627:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692420.845631:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dea6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.845636:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dea6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.845650:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.845656:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.845662:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.845667:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692420.845669:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.845676:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.846203:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec9459a700) 00010000:00010000:3.0:1787692420.846206:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692420.846209:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.846215:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.846266:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dea64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a1 expref: 50 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.846283:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a1 expref: 49 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.846290:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:3.0:1787692420.846293:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787692420.846295:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec80031000, rc 0) 00000100:00100000:3.0:1787692420.846364:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6498a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+49:10549:x1874531108046080:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 2109us (2409us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787692420.846372:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 102 00000100:00100000:1.0:1787692420.851522:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692420.851618:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108046208 00000100:00100000:0.0:1787692420.851628:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108046208 00000100:00100000:0.0:1787692420.851689:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 103 00000100:00100000:0.0:1787692420.851699:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+49:10549:x1874531108046208:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:0.0:1787692420.851757:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.851773:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.851784:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.851809:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.851844:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.851852:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.851876:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692420.851880:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.851888:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.851900:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:0.0:1787692420.851903:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787692420.851908:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.851914:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dea87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692420.851990:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+49:10549:x1874531108046208:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 292us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692420.851997:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 103 00000100:00100000:1.0:1787692420.855574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692420.855695:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108046464 00000100:00100000:3.0:1787692420.855706:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108046464 00000100:00100000:2.0:1787692420.860766:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:2.0:1787692420.860793:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+49:10549:x1874531108046464:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1787692420.861262:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+50:10549:x1874531108046464:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 481us (5695us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1787692420.861271:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:1.0:1787692420.929805:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125887232:0@lo:400:kworker.0 00000100:00100000:2.0:1787692420.929862:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125887360:0@lo:400:kworker.0 00000100:00100000:0.0:1787692420.929942:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125887104:0@lo:400:kworker.0 00000100:00100000:3.0:1787692420.930073:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125887488:0@lo:400:kworker.0 00000100:00100000:2.0:1787692420.936081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692420.936117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692420.936282:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125887360 00000100:00100000:2.0:1787692420.936290:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125887360 00000100:00080000:2.0:1787692420.936319:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692420.936667:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787692420.936678:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125887360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692420.937239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692420.937297:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125887488 00000100:00100000:3.0:1787692420.937302:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125887488 00000100:00100000:3.0:1787692420.937330:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787692420.937337:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaef19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1874531125887488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692420.937618:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874531125887616:0@lo:400:kworker.0 00000100:00100000:0.0:1787692420.937662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692420.937690:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692420.937697:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125887744:0@lo:400:kworker.0 00000100:00100000:0.0:1787692420.937719:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692420.937746:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaef19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1874531125887488:12345-0@lo:400:kworker.0 Request processed in 405us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692420.937747:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125887104 00000100:00100000:0.0:1787692420.937752:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125887104 00000100:00100000:3.0:1787692420.937757:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787692420.937783:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787692420.937798:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3306:x1874531125887104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692420.937807:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692420.938044:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125887744 00000100:00100000:3.0:1787692420.938048:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125887744 00000100:00100000:3.0:1787692420.938070:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787692420.938076:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1874531125887744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692420.940898:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3306:x1874531125887104:12345-0@lo:400:kworker.0 Request processed in 3092us (4773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692420.940912:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1787692420.940989:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf922d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125887104:0@lo:400:kworker.0 00000100:00100000:0.0:1787692420.941050:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125887616 00000100:00100000:0.0:1787692420.941055:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125887616 00000100:00100000:0.0:1787692420.941098:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125887232 00000100:00100000:0.0:1787692420.941100:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125887232 00000100:00100000:0.0:1787692420.941112:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787692420.941117:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874531125887616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692420.941163:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874531125887616:12345-0@lo:400:kworker.0 Request processed in 46us (3502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692420.941169:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787692420.941179:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787692420.941184:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125887232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692420.941207:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125887232:12345-0@lo:400:kworker.0 Request processed in 23us (3402us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692420.941213:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787692420.941239:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf934000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874531125887616:0@lo:400:kworker.0 00000100:00100000:2.0:1787692420.941247:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125887360:12345-0@lo:400:kworker.0 Request processed in 4568us (5170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692420.941256:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1787692420.941278:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692420.941304:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf935500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125887360:0@lo:400:kworker.0 00000100:00100000:0.0:1787692420.941310:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf935180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125887488:0@lo:400:kworker.0 00000100:00100000:3.0:1787692420.946252:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1874531125887744:12345-0@lo:400:kworker.0 Request processed in 8166us (8521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692420.946265:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787692420.946452:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692420.946560:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108046720 00000100:00100000:3.0:1787692420.946569:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108046720 00000100:00100000:3.0:1787692420.946662:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 104 00000100:00100000:3.0:1787692420.946672:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+50:10559:x1874531108046720:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:3.0:1787692420.946704:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692420.946707:0:8461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787692420.946732:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425c00/0x5d8b8560a09dea09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2385 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.946750:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:3.0:1787692420.946756:0:8461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787692420.946769:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dea8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23a8 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.946922:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.946937:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a1 expref: 50 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.946958:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.946990:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a1 expref: 50 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.947008:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a1 expref: 50 pid: 8193 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692420.947021:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf934e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125887872:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692420.947095:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692420.948138:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf934380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125887744:0@lo:400:kworker.0 00000100:00100000:1.0:1787692420.948312:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf935880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125887232:0@lo:400:kworker.0 00000100:00100000:3.0:1787692420.951894:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf934e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125887872:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692420.951923:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692420.956998:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692420.961051:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108046848 00000100:00100000:1.0:1787692420.961066:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108046848 00010000:00010000:1.0:1787692420.961114:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a1 expref: 51 pid: 8193 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692420.961155:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:1.0:1787692420.961165:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+51:2361:x1874531108046848:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787692420.961180:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692420.961188:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a1 expref: 51 pid: 8193 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.961200:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a1 expref: 51 pid: 8193 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.961222:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dea79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a1 expref: 51 pid: 8193 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.961239:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:1.0:1787692420.961244:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.961253:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.961261:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.961306:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692420.961370:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+50:2361:x1874531108046848:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 205us (4378us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692420.961377:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 52 00010000:00010000:0.0:1787692420.961379:0:8461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.961397:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692420.961425:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787692420.961569:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dea8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a8 expref: 51 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.961589:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a8 expref: 50 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692420.961596:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:0.0:1787692420.961599:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787692420.961601:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec80031600, rc 0) 00000100:00100000:0.0:1787692420.961626:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+50:10559:x1874531108046720:12345-192.168.206.27@tcp:101:bash.0 Request processed in 14957us (15177us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787692420.961633:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 104 00000100:00100000:0.0:1787692420.964119:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692420.964277:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108047104 00000100:00100000:1.0:1787692420.964286:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108047104 00000100:00100000:1.0:1787692420.964362:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 105 00000100:00100000:1.0:1787692420.964380:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+50:10559:x1874531108047104:12345-192.168.206.27@tcp:36:bash.0 00010000:00010000:1.0:1787692420.964606:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09deaa3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.964621:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09deaa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.964632:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09deaa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787692420.964671:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1787692420.964691:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdfd2d9b reply state 00000000923f674b transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09deaa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692420.964699:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787692420.964843:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+53:10559:x1874531108047104:12345-192.168.206.27@tcp:36:bash.0 Request processed in 463us (731us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1787692420.964850:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 105 00000020:00080000:1.0:1787692420.964855:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787692420.968131:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09deaa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.968147:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09deaa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.968155:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09deaa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.968161:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692420.968165:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09deaa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692420.968288:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692420.968375:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108047232 00000100:00100000:1.0:1787692420.968384:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108047232 00000100:00100000:1.0:1787692420.968501:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 106 00000100:00100000:1.0:1787692420.968521:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+53:10559:x1874531108047232:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1787692420.968544:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692420.968559:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09deaaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23af expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.968628:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.968642:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a8 expref: 54 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.968650:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09deaa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.968657:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.968671:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09deaa3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.968678:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09deaa3 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.968689:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:1.0:1787692420.968693:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692420.968696:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.968722:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a8 expref: 54 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.968746:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a8 expref: 54 pid: 8461 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692420.968759:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf131180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125888000:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692420.968869:0:3290:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:3.0:1787692420.968873:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09deaa3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692420.968879:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09deaa3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692420.969179:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692420.972077:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692420.972145:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108047360 00000100:00100000:2.0:1787692420.972154:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108047360 00010000:00010000:2.0:1787692420.972267:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a8 expref: 54 pid: 8461 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692420.972347:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:2.0:1787692420.972357:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+54:2362:x1874531108047360:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692420.972381:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692420.972389:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a8 expref: 54 pid: 8461 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.972416:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a8 expref: 54 pid: 8461 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.972438:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:2.0:1787692420.972443:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.972452:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.972459:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692420.972477:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692420.972526:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+54:2362:x1874531108047360:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 170us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692420.972533:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 53 00010000:00010000:1.0:1787692420.972741:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dea95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23a8 expref: 53 pid: 8461 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692420.972758:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf131180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125888000:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692420.972778:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.972787:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.972794:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692420.972875:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787692420.972879:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692420.972898:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.972924:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09deaaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23af expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.972937:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23af expref: 52 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692420.972951:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:1.0:1787692420.972954:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787692420.972956:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164a00, rc 0) 00000100:00100000:1.0:1787692420.972997:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6498e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+52:10559:x1874531108047232:12345-192.168.206.27@tcp:101:bash.0 Request processed in 4478us (4713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692420.973004:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 106 00000100:00100000:0.0:1787692420.977029:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692420.977106:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108047616 00000100:00100000:3.0:1787692420.977116:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108047616 00000100:00100000:3.0:1787692420.977254:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:3.0:1787692420.977265:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+52:10559:x1874531108047616:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:3.0:1787692420.977541:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+53:10559:x1874531108047616:12345-192.168.206.27@tcp:35:bash.0 Request processed in 277us (583us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787692420.977549:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:2.0:1787692421.034883:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692421.034971:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108047744 00000100:00100000:0.0:1787692421.034980:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108047744 00000100:00100000:0.0:1787692421.035041:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 107 00000100:00100000:0.0:1787692421.035050:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+53:10565:x1874531108047744:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692421.035074:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692421.035093:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09deab8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23b6 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.035335:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09deabf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.035348:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09deabf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.035358:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09deabf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692421.035419:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787692421.035423:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692421.035446:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09deabf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.035470:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09deab8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23b6 expref: 55 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.035487:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09deabf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23b6 expref: 54 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.035496:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:0.0:1787692421.035498:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787692421.035502:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0200, rc 0) 00000100:00100000:0.0:1787692421.035558:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+54:10565:x1874531108047744:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 509us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692421.035565:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 107 00000100:00100000:0.0:1787692421.039563:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692421.039658:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108047872 00000100:00100000:1.0:1787692421.039667:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108047872 00000100:00100000:1.0:1787692421.039724:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 108 00000100:00100000:1.0:1787692421.039734:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+54:10565:x1874531108047872:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692421.039752:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692421.039771:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09deac6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23bd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.039992:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deacd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040005:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deacd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040016:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deacd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040030:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dead4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040037:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dead4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040096:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dead4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040263:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040271:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040278:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692421.040311:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787692421.040316:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692421.040330:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040340:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040347:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deacd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040353:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deacd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040358:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deacd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040363:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692421.040367:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deacd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040379:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deacd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040389:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:1.0:1787692421.040391:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692421.040396:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deacd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040412:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deacd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040424:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dead4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040430:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dead4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040436:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dead4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040441:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692421.040443:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dead4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040449:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dead4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.040456:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec9dbfae00) 00010000:00010000:1.0:1787692421.040459:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692421.041274:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dead4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.041298:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dead4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.041446:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09deac6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23bd expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.041461:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23bd expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.041472:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:1.0:1787692421.041475:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787692421.041477:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165200, rc 0) 00000100:00100000:1.0:1787692421.041547:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6499180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+55:10565:x1874531108047872:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1814us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692421.041554:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 108 00000100:00100000:3.0:1787692421.046142:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692421.046318:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108048128 00000100:00100000:1.0:1787692421.046329:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108048128 00000100:00100000:1.0:1787692421.046388:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 109 00000100:00100000:1.0:1787692421.046410:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+55:10565:x1874531108048128:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692421.046429:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692421.046449:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09deae2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23c4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.046543:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.046558:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23af expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.046580:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23bd expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.046587:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.046620:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23bd expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.046633:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23bd expref: 56 pid: 5831 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692421.046648:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf131180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125888128:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692421.046746:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23af expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.046756:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23af expref: 56 pid: 5833 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692421.046765:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf130000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125888256:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692421.046793:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692421.047162:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692421.047292:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108048256 00000100:00100000:0.0:1787692421.047304:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108048256 00010000:00010000:0.0:1787692421.047331:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23bd expref: 57 pid: 5831 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692421.047360:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 54 00000100:00100000:0.0:1787692421.047367:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+57:2361:x1874531108048256:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692421.047376:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692421.047381:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23bd expref: 57 pid: 5831 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.047391:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23bd expref: 57 pid: 5831 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.047418:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:0.0:1787692421.047423:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.047430:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.047436:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692421.047475:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+57:2361:x1874531108048256:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 107us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692421.047482:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 54 00010000:00010000:1.0:1787692421.049579:0:5833:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.27@tcp) returned -22 from blocking AST (req@000000002b86ab52 x1874531125888128) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23bd expref: 56 pid: 5831 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.049603:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09deadb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23bd expref: 56 pid: 5831 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692421.049635:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf131180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125888128:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692421.049652:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf130000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125888256:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692421.049675:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:1.0:1787692421.049680:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.049687:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.049695:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692421.050739:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692421.050957:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108048384 00000100:00100000:3.0:1787692421.050970:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108048384 00010000:00010000:3.0:1787692421.051005:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23af expref: 56 pid: 5833 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692421.051043:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:3.0:1787692421.051054:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+56:2361:x1874531108048384:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692421.051067:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692421.051073:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23af expref: 56 pid: 5833 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.051086:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23af expref: 56 pid: 5833 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.051120:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09deab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23af expref: 56 pid: 5833 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.051250:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:3.0:1787692421.051255:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.051264:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.051272:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.051305:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692421.051362:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+55:2361:x1874531108048384:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 310us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692421.051380:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 55 00010000:00010000:1.0:1787692421.051642:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.051651:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692421.051671:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787692421.051805:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09deae2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23c4 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.051862:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23c4 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.051870:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:1.0:1787692421.051873:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787692421.051883:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164200, rc 0) 00000100:00100000:1.0:1787692421.051924:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf934e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+56:10565:x1874531108048128:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 5527us (5790us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787692421.051932:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 109 00000100:00100000:2.0:1787692421.057580:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692421.058891:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108048640 00000100:00100000:0.0:1787692421.058903:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108048640 00000100:00100000:0.0:1787692421.058970:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:0.0:1787692421.058981:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+55:10565:x1874531108048640:12345-192.168.206.27@tcp:103:lfs.0 00010000:00010000:0.0:1787692421.059011:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692421.059033:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09dea48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b239a expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.059052:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:0.0:1787692421.059058:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692421.059119:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+54:10565:x1874531108048640:12345-192.168.206.27@tcp:103:lfs.0 Request processed in 140us (1548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692421.059126:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:0.0:1787692421.064289:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692421.064537:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108048768 00000100:00100000:3.0:1787692421.064546:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108048768 00000100:00100000:3.0:1787692421.064599:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 110 00000100:00100000:3.0:1787692421.064609:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+54:10565:x1874531108048768:12345-192.168.206.27@tcp:58:lfs.0 00010000:00010000:3.0:1787692421.064719:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09deaf7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.064736:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09deaf7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.064747:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09deaf7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787692421.065583:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787692421.065900:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6499500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+54:10565:x1874531108048768:12345-192.168.206.27@tcp:58:lfs.0 Request processed in 1288us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692421.065910:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 110 00000100:00100000:3.0:1787692421.068794:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692421.069092:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108048896 00000100:00100000:1.0:1787692421.069101:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108048896 00000100:00100000:1.0:1787692421.069328:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 111 00000100:00100000:1.0:1787692421.069340:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+54:10565:x1874531108048896:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692421.069358:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692421.069388:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09deafe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23cb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.069452:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09deaf7 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.069464:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09deafe lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23cb expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.069483:0:5831:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09deaf7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.069497:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09deafe lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23cb expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.069509:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:1.0:1787692421.069512:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787692421.069516:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09deafe lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23cb expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.069540:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164800, rc 0) 00000100:00100000:1.0:1787692421.069600:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf934700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+55:10565:x1874531108048896:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 262us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692421.069607:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 111 00000004:00080000:3.0:1787692421.441227:0:8079:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 327647411459ns, next at 328647409029ns, rc = 0 00000100:00100000:2.0:1787692421.441247:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125888384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787692421.441313:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692421.441460:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125888384 00000100:00100000:3.0:1787692421.441468:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125888384 00000100:00100000:3.0:1787692421.441528:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787692421.441539:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874531125888384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787692421.441571:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692421.441633:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf679880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874531125888384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692421.441640:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787692421.441719:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787692421.444664:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf937b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125888384:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787692421.505174:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787692421.505182:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787692421.505236:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787692421.505243:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787692421.505439:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf679500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874531125888512:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787692421.505616:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec84cdc000 going to sleep for 11 seconds 00000100:00100000:3.0:1787692421.520704:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692421.520870:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108049024 00000100:00100000:1.0:1787692421.520878:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108049024 00000100:00100000:1.0:1787692421.520969:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 112 00000100:00100000:1.0:1787692421.520980:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+56:10566:x1874531108049024:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787692421.521010:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787692421.521130:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf935f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+56:10566:x1874531108049024:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 150us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692421.521138:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 112 00000100:00100000:2.0:1787692421.521857:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf679500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874531125888512:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787692421.527086:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692421.527214:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108049152 00000100:00100000:3.0:1787692421.527227:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108049152 00000100:00100000:3.0:1787692421.527343:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 113 00000100:00100000:3.0:1787692421.527356:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+55:10566:x1874531108049152:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787692421.527528:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09deb05 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.527550:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09deb05 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.527564:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09deb05 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528217:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deb0c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528243:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deb0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528256:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deb0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528289:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528297:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528303:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692421.528348:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787692421.528352:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787692421.528366:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528378:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09deb05 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528384:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09deb05 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528391:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09deb05 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528426:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692421.528431:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09deb05 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528439:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09deb05 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528453:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec832f4e00) 00010000:00010000:3.0:1787692421.528456:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692421.528460:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09deb05 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528466:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09deb05 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528481:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deb0c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528487:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deb0c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528493:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deb0c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528497:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692421.528500:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deb0c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528507:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deb0c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528525:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff92ec9459a700) 00010000:00010000:3.0:1787692421.528528:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692421.528532:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deb0c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528538:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deb0c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528556:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528563:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528570:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528575:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692421.528579:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528586:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528594:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:3.0:1787692421.528596:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692421.528599:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.528605:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692421.528716:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6499f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+55:10566:x1874531108049152:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 Request processed in 1360us (2002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692421.528726:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 113 00000100:00100000:1.0:1787692421.534947:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692421.536579:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108049408 00000100:00100000:0.0:1787692421.536595:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108049408 00000100:00100000:0.0:1787692421.536666:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 114 00000100:00100000:0.0:1787692421.536676:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+55:10566:x1874531108049408:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787692421.536695:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692421.536715:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09deb1a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23d2 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.536806:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09deb21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.536845:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09deb21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.536857:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09deb21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692421.536880:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787692421.536993:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09deb21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.537002:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09deb21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.537008:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09deb21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.537014:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692421.537019:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09deb21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.537026:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09deb21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.537039:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:0.0:1787692421.537041:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787692421.537045:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09deb21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.537050:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09deb21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.537089:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09deb1a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23d2 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.537098:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec832f4e00) 00010000:00010000:0.0:1787692421.537100:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787692421.537110:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09deb1a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23d2 expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.537120:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0800, rc 0) 00000100:00100000:0.0:1787692421.537185:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+56:10566:x1874531108049408:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 511us (2255us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1787692421.537193:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 114 00000100:00100000:0.0:1787692421.541512:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692421.541677:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108049536 00000100:00100000:3.0:1787692421.541692:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108049536 00000100:00100000:3.0:1787692421.541770:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 115 00000100:00100000:3.0:1787692421.541782:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+56:10566:x1874531108049536:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787692421.541856:0:5832:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787692421.541996:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+56:10566:x1874531108049536:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 215us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692421.542005:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 115 00000100:00100000:3.0:1787692421.552776:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692421.557131:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108049792 00000100:00100000:0.0:1787692421.557152:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108049792 00000100:00100000:1.0:1787692421.557994:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 116 00000100:00100000:1.0:1787692421.558009:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+56:10566:x1874531108049792:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787692421.558036:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692421.558040:0:8461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787692421.558074:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09deabf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23b6 expref: 56 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.558099:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:1.0:1787692421.558105:0:8461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787692421.558122:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09deb2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23d9 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787692421.559736:0:8461:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1787692421.560066:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deb36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.560085:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deb36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.560099:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deb36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.560177:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09deb2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23d9 expref: 58 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.560198:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deb36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23d9 expref: 57 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.560208:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ec9dbfae00) 00010000:00010000:1.0:1787692421.560210:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787692421.560214:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164000, rc 0) 00000100:00100000:1.0:1787692421.560368:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf937480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+57:10566:x1874531108049792:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 2360us (7607us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1787692421.560378:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 116 00000100:00100000:1.0:1787692421.579280:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692421.579647:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108050048 00000100:00100000:2.0:1787692421.579661:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108050048 00000100:00100000:2.0:1787692421.579897:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 117 00000100:00100000:2.0:1787692421.579911:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+57:10566:x1874531108050048:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787692421.580000:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692421.580035:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09deb36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23d9 expref: 57 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580059:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ec9dbfae00) 00010000:00010000:2.0:1787692421.580072:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787692421.580099:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09deb44 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580114:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09deb44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580125:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09deb44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580165:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9f3cecae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580173:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f3cecae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580180:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f3cecae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580278:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09deb44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580286:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09deb44 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580292:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09deb44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580298:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692421.580303:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09deb44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580310:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09deb44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580318:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:2.0:1787692421.580322:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692421.580326:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09deb44 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580332:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09deb44 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580348:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f3cecae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580354:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f3cecae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580359:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f3cecae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580382:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692421.580385:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f3cecae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580391:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9f3cecae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580407:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9f3cecae (ffff92ec94636100) 00010000:00010000:2.0:1787692421.580410:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692421.580413:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9f3cecae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.580419:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9f3cecae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692421.580511:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+56:10566:x1874531108050048:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 604us (1247us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787692421.580530:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 117 00000100:00100000:1.0:1787692421.584267:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692421.584650:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108050176 00000100:00100000:0.0:1787692421.584663:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108050176 00000100:00100000:0.0:1787692421.584950:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 118 00000100:00100000:0.0:1787692421.585022:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+56:10566:x1874531108050176:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787692421.585051:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692421.585082:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09deb52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23e0 expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.585132:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deb59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.585150:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deb59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.585163:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deb59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.585304:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09deb52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e0 expref: 58 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.585340:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deb59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e0 expref: 57 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.585350:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692421.585353:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787692421.585358:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1600, rc 0) 00000100:00100000:0.0:1787692421.585729:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+57:10566:x1874531108050176:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 766us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692421.585739:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 118 00000100:00100000:0.0:1787692421.591121:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692421.591282:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108050432 00000100:00100000:1.0:1787692421.591296:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108050432 00000100:00100000:1.0:1787692421.591545:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 119 00000100:00100000:1.0:1787692421.591558:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+57:10566:x1874531108050432:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787692421.591683:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09deb60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.591705:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09deb60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.591720:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09deb60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787692421.592258:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:1.0:1787692421.594577:0:8461:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e15d11f2 reply state 0000000035c96f81 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09deb60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692421.594600:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787692421.595165:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6499880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+59:10566:x1874531108050432:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 3601us (4050us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1787692421.595177:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 119 00010000:00010000:0.0:1787692421.599746:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09deb60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.599770:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09deb60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.599779:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09deb60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.599786:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692421.599793:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09deb60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.599802:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09deb60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.599840:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692421.599844:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787692421.599869:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09deb60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.599877:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09deb60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692421.600509:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692421.601777:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108050560 00000100:00100000:2.0:1787692421.601792:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108050560 00000100:00100000:2.0:1787692421.602150:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 120 00000100:00100000:2.0:1787692421.602176:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+58:10566:x1874531108050560:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692421.602209:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692421.602234:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23e7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.602311:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e7 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.602328:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e7 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.602349:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692421.602352:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787692421.602356:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3200, rc 0) 00000100:00100000:2.0:1787692421.602649:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+59:10566:x1874531108050560:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 474us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692421.602658:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 120 00000100:00100000:2.0:1787692421.606339:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692421.610098:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108050688 00000100:00100000:3.0:1787692421.610120:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108050688 00000100:00100000:3.0:1787692421.610287:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:3.0:1787692421.610299:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+8:2362:x1874531108050688:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787692421.611046:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf679500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+9:2362:x1874531108050688:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 742us (4718us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1787692421.611057:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00080000:2.0:1787692421.612219:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787692421.616145:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692421.616297:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108050944 00000100:00100000:2.0:1787692421.616310:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108050944 00000100:00100000:2.0:1787692421.616391:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 30 00000100:00100000:2.0:1787692421.616413:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+59:10566:x1874531108050944:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787692421.617124:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+60:10566:x1874531108050944:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 710us (990us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787692421.617135:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 30 00000100:00100000:1.0:1787692421.622310:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692421.622592:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108051200 00000100:00100000:0.0:1787692421.622605:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108051200 00000100:00100000:0.0:1787692421.622764:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 121 00000100:00100000:0.0:1787692421.622777:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+60:10566:x1874531108051200:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787692421.623155:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+60:10566:x1874531108051200:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 380us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692421.623165:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 121 00000100:00100000:1.0:1787692421.626567:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692421.626729:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108051328 00000100:00100000:3.0:1787692421.626743:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108051328 00000100:00100000:3.0:1787692421.626870:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 122 00000100:00100000:3.0:1787692421.626882:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+60:10566:x1874531108051328:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787692421.626927:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692421.626955:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09deb6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23ee expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.627054:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deb75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.627071:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deb75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.627083:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deb75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692421.627129:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787692421.627150:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deb75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.627179:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09deb6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23ee expref: 62 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.627199:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deb75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23ee expref: 61 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.627209:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:3.0:1787692421.627212:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787692421.627216:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35b600, rc 0) 00000100:00100000:3.0:1787692421.627292:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+61:10566:x1874531108051328:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 412us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692421.627300:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 122 00000100:00100000:1.0:1787692421.631667:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692421.631868:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108051456 00000100:00100000:2.0:1787692421.631880:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108051456 00000100:00100000:2.0:1787692421.631944:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:2.0:1787692421.631956:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+9:2361:x1874531108051456:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692421.632135:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692421.632164:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09deb7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23f5 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787692421.632196:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8e0585, blocks: 0x1 00010000:00010000:2.0:1787692421.632219:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=327s v=(0 0) 00010000:00010000:2.0:1787692421.632225:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692421.632237:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09deb7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23f5 expref: 10 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.632260:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09deb7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23f5 expref: 10 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.632275:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3a00, rc 0) 00000100:00100000:2.0:1787692421.632346:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf130a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+10:2361:x1874531108051456:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 392us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692421.632354:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 38 00010000:00010000:2.0:1787692421.633148:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692421.637252:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692421.637599:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108051712 00000100:00100000:2.0:1787692421.637612:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108051712 00000100:00100000:2.0:1787692421.637689:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 123 00000100:00100000:2.0:1787692421.637702:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+61:10566:x1874531108051712:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787692421.637885:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+61:10566:x1874531108051712:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 185us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692421.637894:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 123 00000100:00100000:1.0:1787692421.642600:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692421.642688:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108051840 00000100:00100000:3.0:1787692421.642701:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108051840 00000100:00100000:3.0:1787692421.642777:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:3.0:1787692421.642791:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+10:10566:x1874531108051840:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787692421.642853:0:8080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692421.642881:0:8080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f06bb022/0x5d8b8560a09deb83 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b23fc expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.642919:0:8080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09deb7c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23f5 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.642930:0:8080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692421.642935:0:8080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692421.642952:0:8080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f06bb022/0x5d8b8560a09deb83 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23fc expref: 11 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.643002:0:8080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09deb7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23f5 expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.643018:0:8080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09deb7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23f5 expref: 11 pid: 6680 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692421.643035:0:8080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf937800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8080:1874531125888640:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692421.643140:0:8080:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a780 going to sleep for 11 seconds 00000100:00100000:0.0:1787692421.647768:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692421.647873:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108051968 00000100:00100000:2.0:1787692421.647885:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108051968 00010000:00010000:2.0:1787692421.647937:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09deb7c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23f5 expref: 12 pid: 6680 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692421.647998:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:2.0:1787692421.648009:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+12:2361:x1874531108051968:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692421.648026:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692421.648056:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09deb7c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23f5 expref: 12 pid: 6680 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.648071:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09deb7c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23f5 expref: 12 pid: 6680 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.648102:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692421.648107:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692421.648116:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f06bb022/0x5d8b8560a09deb83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23fc expref: 12 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.648127:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f06bb022/0x5d8b8560a09deb83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23fc expref: 12 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.648193:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f06bb022/0x5d8b8560a09deb83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23fc expref: 12 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692421.648208:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf679180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5816:1874531125888768:192.168.206.27@tcp:105: 00000100:00100000:2.0:1787692421.648301:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec84cdc000 going to sleep for 11 seconds 00010000:00010000:3.0:1787692421.648785:0:8080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d821fe1/0x5d8b8560a09deb7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23f5 expref: 12 pid: 6680 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692421.648841:0:8080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf937800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8080:1874531125888640:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692421.648870:0:8080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f06bb022/0x5d8b8560a09deb83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23fc expref: 11 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.648882:0:8080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35ae00, rc 0) 00000100:00100000:3.0:1787692421.648924:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+11:10566:x1874531108051840:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 6136us (6340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692421.648932:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:0.0:1787692421.653711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692421.653872:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108052096 00000100:00100000:1.0:1787692421.653885:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108052096 00002000:00100000:1.0:1787692421.653958:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff92ecaf71fb80 x1874531108052096/t0(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:412/0 lens 504/0 e 0 to 0 dl 1787692432 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787692421.653980:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecaf71fb80 with x1874531108052096 ext(0->12) 00002000:00010000:1.0:1787692421.653987:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecaf71fb80 00000100:00100000:2.0:1787692421.654105:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf679180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5816:1874531125888768:192.168.206.27@tcp:105: 00010000:00010000:2.0:1787692421.654133:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692421.654180:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:3.0:1787692421.654194:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:067f46f5-4779-40e6-b53d-5b3e89751501+11:2362:x1874531108052096:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787692421.654202:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+11:2361:x1874531108051968:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 6196us (6449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692421.654732:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:067f46f5-4779-40e6-b53d-5b3e89751501+13:2362:x1874531108052096:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 Request processed in 539us (1032us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787692421.654743:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00002000:00100000:3.0:1787692421.654752:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff92ecaf71fb80 x1874531108052096/t4294967308(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:412/0 lens 504/448 e 0 to 0 dl 1787692432 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787692421.654761:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecaf71fb80 with x1874531108052096 ext(0->12) 00002000:00010000:3.0:1787692421.654766:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecaf71fb80 00000100:00100000:2.0:1787692421.654926:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:1.0:1787692421.657575:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692421.657716:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108052224 00000100:00100000:0.0:1787692421.657730:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108052224 00000100:00100000:0.0:1787692421.657804:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 124 00000100:00100000:0.0:1787692421.658065:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+61:10566:x1874531108052224:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787692421.715632:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000001:00080000:2.0:1787692421.715674:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1787692421.715689:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:2.0:1787692421.715717:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1787692421.715729:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1787692421.715749:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92ec90a38780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787692421.715755:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ecbc2f3500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92ec90a38e40 00000020:00080000:2.0:1787692421.715759:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ecbc2f3a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92ecb4d2d400 00000004:00080000:2.0:1787692421.715787:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1787692421.715843:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92ec9046ab40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787692421.715847:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ec90970400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92ec9046a3c0 00000020:00080000:2.0:1787692421.715849:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ec90970d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92ecaf10c000 00000020:00080000:2.0:1787692421.715861:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1787692421.716057:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787692421.716291:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787692421.716303:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787692421.716330:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125888896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787692421.716453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692421.716546:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125888896 00000100:00100000:2.0:1787692421.716555:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125888896 00000100:00100000:2.0:1787692421.716621:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787692421.716631:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3304:x1874531125888896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787692421.716667:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1787692421.716709:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8e0584, atime: 0x6a8e0584, ctime: 0x6a8e0584, blocks: 0x1 00010000:00010000:2.0:1787692421.716718:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09deb8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.716738:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:2.0:1787692421.716743:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692421.716751:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09deb8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.716770:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09deb8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.716782:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09deb8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.716792:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09deb8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.716857:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787692421.717414:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3304:x1874531125888896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 782us (959us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787692421.717424:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1787692421.717459:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787692421.717507:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92ecaf679180/2, rc 0, transno 4294967304 00000100:00100000:2.0:1787692421.717515:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125888896:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787692421.718077:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692421.718094:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09deb8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.718105:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2a00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692421.718111:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09deb8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.718121:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09deb8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.718144:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09deb8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.718151:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d85c5a83/0x5d8b8560a09deb8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.718176:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692421.718178:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692421.718180:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692421.718189:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787692421.718205:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125889024:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787692421.718260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692421.718306:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125889024 00000100:00100000:1.0:1787692421.718312:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125889024 00000100:00100000:1.0:1787692421.718354:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787692421.718484:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874531125889024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787692421.718517:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1787692421.718548:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.718568:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09de94c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b235b expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.718577:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787692421.718582:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787692421.718587:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.718621:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09de94c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b235b expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.718638:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09de94c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b235b expref: 11 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692421.718651:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec88aa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874531125889152:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692421.718724:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787692421.722149:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+15:10566:x1874531108052224:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 Request processed in 64319us (64572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692421.722167:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 124 00000100:00100000:0.0:1787692421.725868:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec88aa0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874531125889152:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692421.725921:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692421.726325:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692421.726562:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108052352 00000100:00100000:0.0:1787692421.726571:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108052352 00000100:00100000:3.0:1787692421.726612:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00010000:00010000:0.0:1787692421.726636:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09de94c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b235b expref: 12 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692421.726725:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108052480 00000100:00100000:2.0:1787692421.726730:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108052480 00000100:00100000:2.0:1787692421.726779:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:2.0:1787692421.726792:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+13:2362:x1874531108052480:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787692421.728088:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:0.0:1787692421.728106:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+13:2362:x1874531108052352:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692421.728124:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692421.728133:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09de94c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b235b expref: 13 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.728153:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09de94c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b235b expref: 13 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.728180:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09de94c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b235b expref: 13 pid: 6680 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.728199:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787692421.728204:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787692421.728211:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.728223:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.728257:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692421.728321:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+12:2362:x1874531108052352:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 221us (1998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692421.728343:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 57 00010000:00010000:0.0:1787692421.731747:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.731772:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.731786:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.731794:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.731835:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787692421.731863:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692421.731871:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.731879:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692421.731884:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.731910:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.731935:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.731953:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09deb91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.732641:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692421.732646:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692421.732649:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692421.733733:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874531125889024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15360us (15461us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787692421.733747:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1787692421.733879:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92ecaf133b80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787692421.733904:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125889024:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787692421.764109:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf937800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+11:2362:x1874531108052480:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 Request processed in 37304us (37483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692421.764125:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 42 00000001:00080000:0.0:1787692421.767132:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1787692421.767161:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1787692421.767172:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1787692421.767180:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1787692421.767886:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692421.767989:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108052736 00000100:00100000:3.0:1787692421.768001:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108052736 00000100:00100000:3.0:1787692421.768075:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 125 00000100:00100000:3.0:1787692421.768087:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+15:10566:x1874531108052736:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787692421.768154:0:8461:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692421.768189:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deb75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23ee expref: 15 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.768213:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:3.0:1787692421.768220:0:8461:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787692421.768258:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deb98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.768274:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deb98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.768286:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deb98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787692421.768948:0:8461:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b53ca7d reply state 000000001aa1f564 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deb98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692421.768977:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787692421.769114:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+16:10566:x1874531108052736:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 1026us (1235us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787692421.769124:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 125 00000100:00100000:1.0:1787692421.772307:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692421.772421:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108052864 00000100:00100000:0.0:1787692421.772434:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108052864 00000100:00100000:0.0:1787692421.772509:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:0.0:1787692421.772521:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108052864:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787692421.772846:0:8080:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787692421.772851:0:8080:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787692420 00002000:00010000:0.0:1787692421.772853:0:8080:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787692420 00002000:00010000:0.0:1787692421.772856:0:8080:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787692421 -> 1787692420 00002000:00010000:0.0:1787692421.772858:0:8080:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787692421.772932:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108052864:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 412us (637us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787692421.772940:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 43 00010000:00010000:3.0:1787692421.773461:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deb98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.773492:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deb98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.773500:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deb98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.773507:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692421.773513:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deb98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.773523:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deb98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.773544:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:3.0:1787692421.773548:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692421.773553:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deb98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.773560:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deb98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692421.776270:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692421.776351:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108053120 00000100:00100000:3.0:1787692421.776364:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108053120 00000100:00100000:3.0:1787692421.776449:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 126 00000100:00100000:3.0:1787692421.776462:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+15:10566:x1874531108053120:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787692421.776553:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.776573:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deb59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e0 expref: 15 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.776604:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.776652:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deb59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e0 expref: 15 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.776668:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deb59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e0 expref: 15 pid: 8193 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692421.776685:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf936300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125889280:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692421.776801:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787692421.780413:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692421.780634:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf936300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125889280:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692421.780670:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692421.780901:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108053248 00000100:00100000:2.0:1787692421.780910:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108053248 00010000:00010000:2.0:1787692421.780976:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deb59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e0 expref: 16 pid: 8193 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692421.781017:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00100000:2.0:1787692421.781028:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf934a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+16:2362:x1874531108053248:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692421.781045:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692421.781053:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deb59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e0 expref: 16 pid: 8193 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.781091:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deb59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e0 expref: 16 pid: 8193 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.781117:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deb59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e0 expref: 16 pid: 8193 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.781135:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692421.781141:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.781151:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.781160:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.781182:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692421.781240:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf934a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+15:2362:x1874531108053248:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 214us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692421.781248:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 58 00010000:00010000:1.0:1787692421.781492:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.781500:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.781534:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.781552:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.781559:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.781566:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692421.781571:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.781579:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.781589:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:1.0:1787692421.781592:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787692421.781596:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.781602:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09deb9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692421.781661:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+14:10566:x1874531108053120:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 Request processed in 5201us (5403us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787692421.781671:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 126 00000100:00100000:3.0:1787692421.785310:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692421.785459:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108053376 00000100:00100000:0.0:1787692421.785472:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108053376 00000100:00100000:0.0:1787692421.785561:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:0.0:1787692421.785571:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108053376:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787692421.785626:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.785650:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f06bb022/0x5d8b8560a09deb83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23fc expref: 7 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.785659:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692421.785664:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787692421.785669:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.785709:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f06bb022/0x5d8b8560a09deb83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23fc expref: 7 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.785745:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f06bb022/0x5d8b8560a09deb83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23fc expref: 7 pid: 8080 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692421.785761:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf71f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874531125889408:192.168.206.27@tcp:104: 00000100:00100000:0.0:1787692421.785890:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfc780 going to sleep for 11 seconds 00000100:00100000:1.0:1787692421.788765:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf71f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874531125889408:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692421.788807:0:6679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692421.790203:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692421.791314:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108053504 00000100:00100000:1.0:1787692421.791353:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108053504 00010000:00010000:1.0:1787692421.791436:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f06bb022/0x5d8b8560a09deb83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23fc expref: 8 pid: 8080 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692421.791482:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:1.0:1787692421.791494:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+8:2361:x1874531108053504:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787692421.791513:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692421.791542:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f06bb022/0x5d8b8560a09deb83 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23fc expref: 8 pid: 8080 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.791558:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f06bb022/0x5d8b8560a09deb83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23fc expref: 8 pid: 8080 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.791586:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f06bb022/0x5d8b8560a09deb83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23fc expref: 8 pid: 8080 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.791607:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787692421.791613:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787692421.791620:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.791632:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.791681:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692421.791764:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf936d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108053504:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 272us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692421.791785:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 59 00010000:00010000:3.0:1787692421.793210:0:6679:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.793252:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.793295:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.793305:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.793339:0:6679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.793346:0:6679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0800 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692421.793351:0:6679:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.793372:0:6679:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.793894:0:6679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.793905:0:6679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09deba6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692421.794081:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf936a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108053376:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 Request processed in 8505us (8778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692421.794092:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:1.0:1787692421.799728:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692421.799925:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108053760 00000100:00100000:3.0:1787692421.800067:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108053760 00000100:00100000:3.0:1787692421.800175:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 127 00000100:00100000:3.0:1787692421.800188:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+14:10566:x1874531108053760:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787692421.800288:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.800324:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.800341:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.800762:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.800776:0:8193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e7 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.800785:0:8193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.800853:0:8193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e7 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.800872:0:8193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e7 expref: 15 pid: 5833 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692421.800891:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf936680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125889536:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692421.801023:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692421.804478:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf936680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125889536:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692421.804520:0:8193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692421.806546:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692421.806931:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108053888 00000100:00100000:2.0:1787692421.806952:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108053888 00010000:00010000:2.0:1787692421.807093:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e7 expref: 16 pid: 5833 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692421.807135:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:2.0:1787692421.807145:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+16:2361:x1874531108053888:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692421.807180:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692421.807188:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb67 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e7 expref: 16 pid: 5833 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.807202:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e7 expref: 16 pid: 5833 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.807225:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deb67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23e7 expref: 16 pid: 5833 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.807244:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692421.807249:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.807260:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.807267:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692421.807302:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692421.807378:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+15:2361:x1874531108053888:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 234us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692421.807386:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 60 00010000:00010000:0.0:1787692421.807523:0:8193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.807532:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787692421.807770:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1787692421.808111:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1787692421.808167:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1787692421.808267:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf71ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8193:1874531125889664:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787692421.808338:0:8193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692421.808375:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9144ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787692421.808647:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125889664 00000100:00100000:3.0:1787692421.808666:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125889664 00000100:00100000:3.0:1787692421.808719:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787692421.808729:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8193:x1874531125889664:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787692421.810426:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8193:x1874531125889664:12345-0@lo:1000:mdt00_003.0 Request processed in 1688us (2076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692421.810440:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787692421.810693:0:8193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787692421.810700:0:8193:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1787692421.810729:0:8193:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff92ecaf133b80 x1874531125889024/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787692437 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692421.810744:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf71ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8193:1874531125889664:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787692421.811508:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787692421.811614:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8193:1874531125889792:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787692421.811689:0:8193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692421.811726:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787692421.811761:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125889792 00000100:00100000:1.0:1787692421.811768:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125889792 00000100:00100000:1.0:1787692421.811842:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787692421.811853:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8193:x1874531125889792:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787692421.812089:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8193:x1874531125889792:12345-0@lo:1000:mdt00_003.0 Request processed in 236us (399us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787692421.812096:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787692421.812273:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8193:1874531125889792:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787692421.812317:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812329:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812336:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812342:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692421.812347:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812355:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812385:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:3.0:1787692421.812389:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787692421.812408:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812417:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09debb4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812466:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09deaf7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812472:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09deaf7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812478:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09deaf7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812482:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692421.812485:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09deaf7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812490:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09deaf7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812499:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:3.0:1787692421.812502:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787692421.812509:0:8193:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09deafe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23cb expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812521:0:8193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09deafe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23cb expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812530:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09deafe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23cb expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.812563:0:8193:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09deafe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23cb expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692421.812587:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf936680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125889920:192.168.206.27@tcp:105: 00000100:00100000:3.0:1787692421.812675:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692421.815903:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf936680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125889920:192.168.206.27@tcp:105: 00010000:00010000:3.0:1787692421.815946:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09deaf7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.815958:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09deaf7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816012:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09debbb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816028:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09debbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816041:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09debbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816053:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09debbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816061:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09debbb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816067:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09debbb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816074:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692421.816078:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09debbb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816105:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09debbb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816119:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:3.0:1787692421.816123:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692421.816127:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09debbb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816133:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09debbb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816144:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816150:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816156:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816161:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692421.816164:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816170:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816177:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:3.0:1787692421.816180:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787692421.816182:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.816197:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692421.816516:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+18:10566:x1874531108053760:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 16328us (16800us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1787692421.816528:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 127 00000020:00080000:3.0:1787692421.816536:0:8193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787692421.816746:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787692421.816752:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787692421.817275:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787692421.817284:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787692421.820049:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692421.820180:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108054016 00000100:00100000:0.0:1787692421.820193:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108054016 00000100:00100000:0.0:1787692421.820259:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:0.0:1787692421.820271:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+18:10565:x1874531108054016:12345-192.168.206.27@tcp:49:lfs.0 00000100:00100000:0.0:1787692421.820609:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+18:10565:x1874531108054016:12345-192.168.206.27@tcp:49:lfs.0 Request processed in 339us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692421.820618:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:1.0:1787692421.823082:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692421.823220:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108054272 00000100:00100000:3.0:1787692421.823234:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108054272 00000100:00100000:3.0:1787692421.823304:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00100000:3.0:1787692421.823315:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83553050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+18:10566:x1874531108054272:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787692421.824179:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787692421.824318:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1787692421.824375:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.824408:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.824423:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.824432:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debc2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.824439:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debc2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.824446:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.824482:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787692421.824611:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83553050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+20:10566:x1874531108054272:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 1294us (1537us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1787692421.824622:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 32 00000020:00080000:3.0:1787692421.824628:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787692421.825217:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692421.825228:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.825238:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692421.825243:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.825265:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.825284:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff92ec9459ab00) 00010000:00010000:1.0:1787692421.825288:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787692421.825293:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debc2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.825300:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09debc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.825325:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692421.825328:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692421.825329:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692421.828383:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692421.828491:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108054528 00000100:00100000:3.0:1787692421.828504:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108054528 00000100:00100000:3.0:1787692421.828577:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 128 00000100:00100000:3.0:1787692421.828588:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+20:10565:x1874531108054528:12345-192.168.206.27@tcp:58:lfs.0 00000040:00080000:3.0:1787692421.829165:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787692421.829445:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+20:10565:x1874531108054528:12345-192.168.206.27@tcp:58:lfs.0 Request processed in 855us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692421.829458:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 128 00000100:00100000:2.0:1787692421.871428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692421.871752:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108054656 00000100:00100000:1.0:1787692421.871777:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108054656 00000100:00100000:1.0:1787692421.871884:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 129 00000100:00100000:1.0:1787692421.871896:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+20:10569:x1874531108054656:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692421.871922:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692421.871943:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09debc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2403 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.873383:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09debd0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.873580:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09debd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.873593:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09debd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.873626:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09debd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.873633:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09debd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.873640:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09debd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.874962:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09debde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.874983:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23c4 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.874992:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09debde lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.875034:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23c4 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692421.875051:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23c4 expref: 21 pid: 5833 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692421.875128:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125890048:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692421.875425:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787692421.880748:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125890048:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692421.880796:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09debde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692421.881361:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692421.881728:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108054912 00000100:00100000:3.0:1787692421.881738:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108054912 00000100:00100000:3.0:1787692421.881877:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:3.0:1787692421.881890:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+22:5598:x1874531108054912:12345-192.168.206.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787692421.882211:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+23:5598:x1874531108054912:12345-192.168.206.27@tcp:35:ldlm_bl.0 Request processed in 322us (851us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787692421.882220:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:1.0:1787692421.885601:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692421.885730:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108055040 00000100:00100000:0.0:1787692421.888117:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108055040 00010000:00010000:0.0:1787692421.888186:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23c4 expref: 23 pid: 5833 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692421.888912:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:0.0:1787692421.888926:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+23:2361:x1874531108055040:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692421.888942:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692421.888950:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23c4 expref: 23 pid: 5833 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.889033:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23c4 expref: 23 pid: 5833 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.889057:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09deae9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23c4 expref: 23 pid: 5833 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.889074:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:0.0:1787692421.889079:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09debde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.889089:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09debde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.889096:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09debde lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692421.889237:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692421.889299:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+22:2361:x1874531108055040:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 376us (3705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692421.889307:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 61 00010000:00010000:3.0:1787692421.890627:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09debde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890641:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09debde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692421.890700:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787692421.890704:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787692421.890723:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09debde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890737:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09debde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890746:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09debd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890753:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09debd0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890759:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09debd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890835:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692421.890841:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09debd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890849:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09debd0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890862:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:3.0:1787692421.890865:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692421.890869:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09debd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890875:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09debd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890901:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09debd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890907:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09debd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890913:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09debd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890919:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692421.890922:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09debd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890928:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09debd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890936:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff92ec9dbfa600) 00010000:00010000:3.0:1787692421.890938:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692421.890941:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09debd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890946:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09debd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.890984:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09debc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2403 expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.891283:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09debde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2403 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692421.891302:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:3.0:1787692421.891305:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787692421.891307:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164000, rc 0) 00000100:00100000:2.0:1787692421.891467:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+21:10569:x1874531108054656:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 19570us (20049us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692421.891484:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 129 00000100:00100000:2.0:1787692422.470602:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787692422.470621:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125890176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787692422.470679:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692422.471036:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125890176 00000100:00100000:3.0:1787692422.471043:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125890176 00000100:00100000:3.0:1787692422.471089:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787692422.471097:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3306:x1874531125890176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787692422.471126:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692422.471170:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3306:x1874531125890176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692422.471176:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787692422.471215:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125890176:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787692422.546711:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1787692422.546730:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1787692422.546742:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:2.0:1787692422.661204:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787692422.663977:0:12045:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787692422.663986:0:12045:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787692422.664041:0:12045:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787692422.664046:0:12045:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787692422.848990:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787692422.848998:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787692422.849032:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787692422.849038:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787692422.849150:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874531125890304:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787692422.849259:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec905cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787692422.854255:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874531125890304:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787692422.854968:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692422.855366:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108055168 00000100:00100000:0.0:1787692422.855374:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108055168 00000100:00100000:0.0:1787692422.855485:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 130 00000100:00100000:0.0:1787692422.855495:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+21:10581:x1874531108055168:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787692422.855528:0:8193:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787692422.855630:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf935c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+21:10581:x1874531108055168:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 135us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692422.855637:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 130 00000100:00080000:3.0:1787692422.861904:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692422.866594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692422.866855:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108055424 00000100:00100000:2.0:1787692422.866866:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108055424 00000100:00100000:2.0:1787692422.866924:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 131 00000100:00100000:2.0:1787692422.866934:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+21:10581:x1874531108055424:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692422.866953:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692422.866972:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09debe5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b240a expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.867063:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09debec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.867082:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09debec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.867094:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09debec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692422.867107:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787692422.867231:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09debe5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b240a expref: 24 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.867248:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09debec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b240a expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.867257:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:2.0:1787692422.867260:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692422.867263:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3800, rc 0) 00000100:00100000:2.0:1787692422.867321:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf936680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+23:10581:x1874531108055424:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 388us (736us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787692422.867328:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 131 00000100:00100000:0.0:1787692422.876118:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692422.877699:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108055552 00000100:00100000:3.0:1787692422.877712:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108055552 00000100:00100000:3.0:1787692422.877877:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:3.0:1787692422.877889:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+23:2362:x1874531108055552:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692422.877903:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692422.877929:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09debec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b240a expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692422.877947:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:3.0:1787692422.877952:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692422.878016:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+22:2362:x1874531108055552:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 129us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692422.878065:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:2.0:1787692422.882618:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692422.882744:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108055808 00000100:00100000:2.0:1787692422.882752:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108055808 00000100:00100000:2.0:1787692422.883509:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 132 00000100:00100000:2.0:1787692422.883519:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+22:10581:x1874531108055808:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787692422.883590:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09debfa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.883606:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09debfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.883624:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09debfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.883836:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09debfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.883844:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09debfa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.883851:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09debfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.883857:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692422.883862:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09debfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.883869:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09debfa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.883881:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:2.0:1787692422.883884:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787692422.883888:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09debfa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692422.883894:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09debfa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692422.884033:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+23:10581:x1874531108055808:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 513us (1424us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787692422.884042:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 132 00000040:00080000:2.0:1787692422.884229:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787692422.884234:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787692422.884737:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787692422.884745:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787692422.886667:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692422.886731:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108056064 00000100:00100000:0.0:1787692422.886740:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108056064 00000100:00100000:0.0:1787692422.887055:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:0.0:1787692422.887066:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+23:10581:x1874531108056064:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787692422.887293:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+24:10581:x1874531108056064:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 227us (633us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1787692422.887301:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 34 00010000:00010000:1.0:1787692423.681248:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787692424.505676:0:12096:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787692424.505689:0:12096:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787692424.505733:0:12096:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787692424.505738:0:12096:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787692424.657909:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692424.658206:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108056320 00000100:00100000:1.0:1787692424.658216:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108056320 00000100:00100000:1.0:1787692424.658327:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 133 00000100:00100000:1.0:1787692424.658338:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+24:10601:x1874531108056320:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692424.658360:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692424.658401:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09dec01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2411 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692424.658497:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09dec08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692424.658512:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09dec08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692424.658526:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09dec08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692424.658538:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787692424.658676:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09dec01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2411 expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692424.658694:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09dec08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2411 expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692424.658704:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:1.0:1787692424.658707:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787692424.658720:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164200, rc 0) 00000100:00100000:1.0:1787692424.658797:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+26:10601:x1874531108056320:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 460us (895us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787692424.658804:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 133 00000100:00080000:3.0:1787692424.660061:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692424.663048:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692424.663095:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108056448 00000100:00100000:0.0:1787692424.663105:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108056448 00000100:00100000:0.0:1787692424.663178:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 134 00000100:00100000:0.0:1787692424.663189:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+26:10601:x1874531108056448:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:0.0:1787692424.663261:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dec16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692424.663279:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dec16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692424.663290:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dec16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692424.663319:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dec16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692424.663326:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dec16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692424.663333:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dec16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692424.663339:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692424.663349:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dec16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692424.663357:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dec16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692424.663386:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:0.0:1787692424.663389:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787692424.663578:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dec16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692424.663597:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1400/0x5d8b8560a09dec16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692424.663673:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf937100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+26:10601:x1874531108056448:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 485us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692424.663682:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 134 00010000:00010000:0.0:1787692424.710457:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692424.783708:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692424.783847:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108056576 00000100:00100000:0.0:1787692424.783857:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108056576 00000100:00100000:0.0:1787692424.783917:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:0.0:1787692424.783929:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:2364:x1874531108056576:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:0.0:1787692424.783948:0:8080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692424.783969:0:8080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09dec1d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2418 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787692424.783999:0:8080:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8e0584, atime: 0x6a8e0584, ctime: 0x6a8e0584, blocks: 0xb 00010000:00010000:0.0:1787692424.784018:0:8080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1787692424.784023:0:8080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692424.784034:0:8080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09dec1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2418 expref: 7 pid: 8080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692424.784053:0:8080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09dec1d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2418 expref: 7 pid: 8080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692424.784068:0:8080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1400, rc 0) 00000100:00100000:0.0:1787692424.784134:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:2364:x1874531108056576:12345-192.168.206.27@tcp:101:cat.0 Request processed in 207us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692424.784154:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00080000:3.0:1787692424.784236:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787692424.787613:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692424.787805:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108056704 00000100:00100000:1.0:1787692424.787859:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108056704 00002000:00100000:1.0:1787692424.787909:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff92ecaf934a80 x1874531108056704/t0(0) o3->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:415/0 lens 488/0 e 0 to 0 dl 1787692435 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787692424.787919:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecaf934a80 with x1874531108056704 ext(0->4095) 00002000:00010000:1.0:1787692424.787925:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecaf934a80 00000100:00100000:1.0:1787692424.787956:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:1.0:1787692424.787966:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf934a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108056704:12345-192.168.206.27@tcp:3:cat.0 00000100:00100000:1.0:1787692424.788183:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf934a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108056704:12345-192.168.206.27@tcp:3:cat.0 Request processed in 217us (579us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787692424.788190:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 3 00002000:00100000:1.0:1787692424.788197:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff92ecaf934a80 x1874531108056704/t0(0) o3->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:415/0 lens 488/4536 e 0 to 0 dl 1787692435 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787692424.788205:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecaf934a80 with x1874531108056704 ext(0->4095) 00002000:00010000:1.0:1787692424.788209:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecaf934a80 00000100:00100000:3.0:1787692425.382186:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692425.382234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692425.382271:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692425.382308:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108057088 00000100:00100000:0.0:1787692425.382412:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108056832 00000100:00100000:0.0:1787692425.382420:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108056832 00000100:00100000:1.0:1787692425.382443:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108056960 00000100:00100000:1.0:1787692425.382450:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108056960 00000100:00100000:0.0:1787692425.382472:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 282 00000100:00100000:0.0:1787692425.382484:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108056832:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692425.382556:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108056832:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 75us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692425.382566:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 282 00000100:00100000:1.0:1787692425.382588:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 72 00000100:00100000:1.0:1787692425.382599:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108056960:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692425.382609:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108057088 00000100:00100000:1.0:1787692425.382632:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108056960:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 36us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692425.382646:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 72 00000100:00100000:3.0:1787692425.382647:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 127 00000100:00100000:3.0:1787692425.382655:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108057088:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692425.382687:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf936300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108057088:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 33us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692425.382694:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 127 00000100:00080000:3.0:1787692425.382807:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787692425.382827:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787692425.729013:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692426.051687:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125890688:0@lo:400:kworker.0 00000100:00100000:1.0:1787692426.051752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692426.051798:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787692426.051804:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125890816:0@lo:400:kworker.0 00000100:00100000:1.0:1787692426.051853:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692426.051883:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125890688 00000100:00100000:1.0:1787692426.051890:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125890688 00000100:00100000:2.0:1787692426.051911:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125890432:0@lo:400:kworker.0 00000100:00100000:1.0:1787692426.051949:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1787692426.051955:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692426.051961:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb4f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125890688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692426.051983:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125890944:0@lo:400:kworker.0 00000100:00100000:2.0:1787692426.052020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692426.052020:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb4f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125890688:12345-0@lo:400:kworker.0 Request processed in 61us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692426.052031:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787692426.052050:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125890944 00000100:00100000:1.0:1787692426.052053:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125890944 00000100:00100000:2.0:1787692426.052058:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787692426.052066:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874531125890560:0@lo:400:kworker.0 00000100:00100000:1.0:1787692426.052085:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787692426.052094:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125890944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692426.052097:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692426.052118:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125891072:0@lo:400:kworker.0 00000100:00100000:1.0:1787692426.052136:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125890944:12345-0@lo:400:kworker.0 Request processed in 42us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692426.052144:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787692426.052150:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692426.052158:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125890560 00000100:00100000:1.0:1787692426.052163:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125890560 00000100:00100000:1.0:1787692426.052183:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1787692426.052190:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125890944:0@lo:400:kworker.0 00000100:00100000:1.0:1787692426.052192:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874531125890560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692426.052239:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874531125890560:12345-0@lo:400:kworker.0 Request processed in 48us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692426.052250:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874531125890560:0@lo:400:kworker.0 00000100:00100000:1.0:1787692426.052255:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787692426.052285:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125890816 00000100:00100000:1.0:1787692426.052290:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125890816 00000100:00100000:1.0:1787692426.052326:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125891072 00000100:00100000:1.0:1787692426.052329:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125891072 00000100:00100000:1.0:1787692426.052355:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787692426.052362:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaec77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125890816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692426.052385:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787692426.052397:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874531125891072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692426.052411:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaec77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125890816:12345-0@lo:400:kworker.0 Request processed in 50us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692426.052419:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1787692426.052441:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787692426.052446:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874531125891072:12345-0@lo:400:kworker.0 Request processed in 52us (296us total) trans 0 rc 0/0 00000100:00080000:1.0:1787692426.052446:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787692426.052451:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692426.052458:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787692426.052490:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000100:00100000:2.0:1787692426.052496:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125891072:0@lo:400:kworker.0 00000004:00080000:1.0:1787692426.052497:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1787692426.052518:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92ec91f44000, transno 4294967301 00000004:00080000:1.0:1787692426.052541:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1787692426.052553:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92ecaf679180, transno 4294967304 00000100:00100000:1.0:1787692426.052560:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125890816:0@lo:400:kworker.0 00000100:00100000:1.0:1787692426.052573:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125890688:0@lo:400:kworker.0 00000100:00100000:0.0:1787692426.052718:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125890432 00000100:00100000:0.0:1787692426.052723:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125890432 00000100:00100000:0.0:1787692426.052761:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787692426.052768:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125890432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692426.052808:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125890432:12345-0@lo:400:kworker.0 Request processed in 41us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692426.052833:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787692426.052877:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125890432:0@lo:400:kworker.0 00000004:00080000:1.0:1787692426.561652:0:8079:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332767836306ns, next at 333767833958ns, rc = 0 00000100:00100000:1.0:1787692426.561685:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125891200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787692426.561755:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692426.561856:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125891200 00000100:00100000:1.0:1787692426.561863:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125891200 00000100:00100000:1.0:1787692426.561909:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787692426.561918:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874531125891200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787692426.561966:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692426.562014:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874531125891200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692426.562021:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787692426.562090:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125891200:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787692426.760535:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787692427.150469:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000004:00080000:2.0:1787692427.150498:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:2.0:1787692427.150512:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787692427.150519:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92eca6cfb480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787692427.150523:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ec88919700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92eca6cfb6c0 00000020:00080000:2.0:1787692427.150527:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ec88919200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92eca64bcc00 00000020:00080000:2.0:1787692427.150555:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1787692427.150726:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787692427.150934:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1787692427.151375:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125891328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787692427.151444:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692427.151519:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125891328 00000100:00100000:1.0:1787692427.151528:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125891328 00000100:00100000:1.0:1787692427.151569:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787692427.151578:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1874531125891328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787692427.151754:0:8080:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787692427.151759:0:8080:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787692420 -> 1787692420 00002000:00010000:1.0:1787692427.151761:0:8080:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1787692420 -> 1787692420 00002000:00010000:1.0:1787692427.151763:0:8080:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787692420 -> 1787692420 00002000:00010000:1.0:1787692427.151765:0:8080:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787692427.151803:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1874531125891328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 225us (359us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1787692427.151810:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:1.0:1787692427.151872:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92ecaf71ce00/2, rc 0, transno 4294967312 00000100:00100000:1.0:1787692427.151878:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125891328:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1787692427.196997:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1787692427.197011:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1787692427.197016:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:0.0:1787692427.585099:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb5332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125891456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692427.585170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692427.585296:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125891456 00000100:00100000:3.0:1787692427.585303:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125891456 00000100:00100000:3.0:1787692427.585352:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787692427.585372:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125891456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787692427.585402:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692427.585461:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125891456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692427.585495:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787692427.585758:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb5332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125891456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787692427.777048:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692428.801215:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692429.190901:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692429.191081:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108057216 00000100:00100000:1.0:1787692429.191091:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108057216 00000100:00100000:1.0:1787692429.191172:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 135 00000100:00100000:1.0:1787692429.191183:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+13:10254:x1874531108057216:12345-192.168.206.27@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787692429.191306:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+13:10254:x1874531108057216:12345-192.168.206.27@tcp:60:lhsmtool_posix.0 Request processed in 125us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692429.191314:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 135 00000100:00080000:3.0:1787692429.191425:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692429.195865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692429.197696:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108057472 00000100:00100000:0.0:1787692429.197728:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108057472 00000100:00100000:0.0:1787692429.197800:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:0.0:1787692429.197855:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+13:10254:x1874531108057472:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787692429.198331:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+14:10254:x1874531108057472:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 521us (2474us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787692429.198340:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:0.0:1787692429.551345:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692429.551475:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108057600 00000100:00100000:1.0:1787692429.551485:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108057600 00000100:00100000:1.0:1787692429.551557:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 136 00000100:00100000:1.0:1787692429.551567:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+5:11053:x1874531108057600:12345-192.168.206.27@tcp:101:lsof.0 00010000:00010000:1.0:1787692429.551587:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692429.551607:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dec24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b241f expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692429.551668:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692429.551682:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692429.551692:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692429.551930:0:8193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787692429.551934:0:8193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692429.552048:0:8193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692429.552076:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dec24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b241f expref: 7 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692429.552092:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b241f expref: 6 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692429.552108:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a200) 00010000:00010000:1.0:1787692429.552111:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787692429.552115:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165200, rc 0) 00000100:00100000:1.0:1787692429.552180:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+6:11053:x1874531108057600:12345-192.168.206.27@tcp:101:lsof.0 Request processed in 614us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692429.552188:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 136 00000100:00080000:3.0:1787692429.552566:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787692429.825171:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692430.498675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692430.498723:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692430.498753:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692430.498785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692430.498839:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692430.498867:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108057984 00000100:00100000:2.0:1787692430.498878:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108057984 00000100:00100000:1.0:1787692430.498960:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108058112 00000100:00100000:1.0:1787692430.498975:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108058112 00000100:00100000:1.0:1787692430.499059:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:1.0:1787692430.499073:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108058112:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692430.499185:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108058112:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 114us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692430.499194:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:0.0:1787692430.499384:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108057728 00000100:00100000:0.0:1787692430.499392:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108057728 00000100:00100000:0.0:1787692430.499436:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 284 00000100:00100000:0.0:1787692430.499446:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec88b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2361:x1874531108057728:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692430.499505:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec88b2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2361:x1874531108057728:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 60us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692430.499512:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 284 00000100:00100000:0.0:1787692430.499581:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108057856 00000100:00100000:0.0:1787692430.499586:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108057856 00000100:00100000:0.0:1787692430.499613:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108058240 00000100:00100000:0.0:1787692430.499616:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108058240 00000100:00100000:0.0:1787692430.499649:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 131 00000100:00100000:0.0:1787692430.499656:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+14:2361:x1874531108057856:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692430.499695:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+14:2361:x1874531108057856:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 40us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692430.499701:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 131 00000100:00100000:0.0:1787692430.499713:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 132 00000100:00100000:0.0:1787692430.499719:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+6:2362:x1874531108058240:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692430.499759:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+6:2362:x1874531108058240:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 41us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692430.499765:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 132 00000100:00080000:0.0:1787692430.499798:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787692430.499802:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787692430.503068:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 76 00000100:00100000:2.0:1787692430.503088:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108057984:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692430.503958:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108057984:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 875us (5231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692430.503967:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 76 00010000:00010000:2.0:1787692430.849677:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787692431.106073:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787692431.106088:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787692431.106653:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787692431.106788:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787692431.169182:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125891712:0@lo:400:kworker.0 00000100:00100000:3.0:1787692431.169262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692431.169315:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125892224:0@lo:400:kworker.0 00000100:00100000:3.0:1787692431.169336:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692431.169376:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692431.169382:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125891840:0@lo:400:kworker.0 00000100:00100000:3.0:1787692431.169402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692431.169463:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125891712 00000100:00100000:0.0:1787692431.169470:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125891712 00000100:00100000:0.0:1787692431.169514:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125891840 00000100:00100000:0.0:1787692431.169516:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125891840 00000100:00100000:0.0:1787692431.169542:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787692431.169549:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125891712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692431.169596:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf935880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125891712:12345-0@lo:400:kworker.0 Request processed in 48us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692431.169603:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787692431.169619:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787692431.169623:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125891840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692431.169643:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf935180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125891840:12345-0@lo:400:kworker.0 Request processed in 20us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692431.169648:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1787692431.169661:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692431.169687:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125891840:0@lo:400:kworker.0 00000100:00100000:1.0:1787692431.169695:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125891584:0@lo:400:kworker.0 00000100:00100000:0.0:1787692431.169699:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125891712:0@lo:400:kworker.0 00000100:00100000:1.0:1787692431.169740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692431.169763:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125892224 00000100:00100000:0.0:1787692431.169767:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125892224 00000100:00100000:1.0:1787692431.169770:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125892096:0@lo:400:kworker.0 00000100:00100000:1.0:1787692431.169800:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692431.169806:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787692431.169840:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874531125892224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692431.169848:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787692431.169857:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125891968:0@lo:400:kworker.0 00000100:00100000:1.0:1787692431.169892:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692431.169899:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf934380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874531125892224:12345-0@lo:400:kworker.0 Request processed in 85us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692431.169906:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787692431.169921:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125891968 00000100:00100000:0.0:1787692431.169924:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125891968 00000100:00100000:1.0:1787692431.169926:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125891584 00000100:00100000:1.0:1787692431.169931:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125891584 00000100:00100000:0.0:1787692431.169953:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787692431.169960:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125891968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692431.169967:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787692431.169977:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125891584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692431.169994:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125891968:12345-0@lo:400:kworker.0 Request processed in 34us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692431.170000:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1787692431.170014:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787692431.170017:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787692431.170035:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000100:00100000:1.0:1787692431.170036:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125891584:12345-0@lo:400:kworker.0 Request processed in 61us (295us total) trans 0 rc 0/0 00000004:00080000:0.0:1787692431.170041:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92ecaf133b80, transno 4294967309 00000100:00100000:1.0:1787692431.170048:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000004:00080000:0.0:1787692431.170053:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:0.0:1787692431.170077:0:3306:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff92ecaf71ce00 x1874531125891328/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787692443 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692431.170081:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125892096 00000100:00100000:1.0:1787692431.170087:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125892096 00000100:00100000:0.0:1787692431.170091:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125892224:0@lo:400:kworker.0 00000100:00100000:1.0:1787692431.170125:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787692431.170133:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125892096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692431.170165:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125892096:12345-0@lo:400:kworker.0 Request processed in 34us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692431.170171:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1787692431.170199:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692431.170225:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125891968:0@lo:400:kworker.0 00000100:00100000:1.0:1787692431.170234:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125891584:0@lo:400:kworker.0 00000100:00100000:1.0:1787692431.170244:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125892096:0@lo:400:kworker.0 00000100:00100000:0.0:1787692431.681282:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125892352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787692431.681362:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692431.681551:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125892352 00000100:00100000:3.0:1787692431.681559:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125892352 00000100:00100000:3.0:1787692431.681614:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787692431.681624:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874531125892352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787692431.681658:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692431.681709:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874531125892352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692431.681716:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787692431.681965:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125892352:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787692431.874482:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787692432.234101:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787692432.234117:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1787692432.234253:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1787692432.234267:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:0.0:1787692432.237012:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:1.0:1787692432.706162:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125892480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787692432.706519:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692432.706601:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125892480 00000100:00100000:3.0:1787692432.706617:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125892480 00000100:00100000:3.0:1787692432.706683:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787692432.706693:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125892480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787692432.706730:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692432.706846:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125892480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 155us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692432.706854:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787692432.707750:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125892480:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787692432.878033:0:12301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 17:13:51 (1787692431) 00010000:00010000:0.0:1787692432.896932:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692433.866010:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692433.866255:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108058496 00000100:00100000:0.0:1787692433.866287:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108058496 00000100:00100000:0.0:1787692433.866409:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 137 00000100:00100000:0.0:1787692433.866423:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+13:11318:x1874531108058496:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787692433.866450:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692433.866478:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dec32 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2426 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.866574:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09dec39 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.866593:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09dec39 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.866609:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09dec39 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.866627:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09dec40 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.866635:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09dec40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.866642:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09dec40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867250:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09dec47 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867264:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09dec47 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867272:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09dec47 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692433.867290:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787692433.867606:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09dec39 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867616:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09dec39 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867624:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09dec39 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867631:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692433.867636:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09dec39 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867643:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09dec39 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867657:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92ec832f4400) 00010000:00010000:0.0:1787692433.867661:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692433.867667:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09dec39 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787692433.867800:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787692433.867897:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09dec39 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867916:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09dec40 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867923:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09dec40 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867939:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09dec40 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867945:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692433.867948:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09dec40 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867954:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09dec40 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867963:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff92ec832f4900) 00010000:00010000:0.0:1787692433.867966:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692433.867969:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09dec40 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.867975:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09dec40 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.868635:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dec32 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2426 expref: 16 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.868655:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09dec47 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2426 expref: 15 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.868663:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec832f4e00) 00010000:00010000:0.0:1787692433.868666:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692433.868669:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0200, rc 0) 00000100:00100000:0.0:1787692433.868912:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf935500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+15:11318:x1874531108058496:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 2490us (2915us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787692433.868932:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 137 00000100:00100000:1.0:1787692433.878085:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692433.878139:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692433.878261:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108058624 00000100:00100000:2.0:1787692433.878274:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108058624 00000100:00100000:2.0:1787692433.878387:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 138 00000100:00100000:2.0:1787692433.878400:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+15:11318:x1874531108058624:12345-192.168.206.27@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787692433.878547:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+15:11318:x1874531108058624:12345-192.168.206.27@tcp:59:lhsmtool_posix.0 Request processed in 149us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692433.878555:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 138 00000100:00100000:0.0:1787692433.884048:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108058752 00000100:00100000:0.0:1787692433.884069:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108058752 00000100:00100000:0.0:1787692433.884170:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:0.0:1787692433.884182:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+15:2364:x1874531108058752:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692433.884199:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692433.884229:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09dec47 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2426 expref: 15 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692433.884251:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec832f4e00) 00010000:00010000:0.0:1787692433.884256:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692433.885124:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+14:2364:x1874531108058752:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 936us (6976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692433.885135:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00010000:00010000:1.0:1787692433.921115:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787692434.177058:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787692434.177066:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787692434.177116:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1787692434.177132:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787692434.945039:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692435.620971:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692435.621013:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692435.621049:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692435.621118:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108059008 00000100:00100000:2.0:1787692435.621129:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108059008 00000100:00100000:2.0:1787692435.621205:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 136 00000100:00100000:2.0:1787692435.621216:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+14:2361:x1874531108059008:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692435.621291:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+14:2361:x1874531108059008:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 77us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692435.621299:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 136 00000100:00100000:2.0:1787692435.621585:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108058880 00000100:00100000:2.0:1787692435.621591:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108058880 00000100:00100000:2.0:1787692435.621965:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 286 00000100:00100000:2.0:1787692435.621973:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108058880:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692435.622012:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108058880:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 39us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692435.622018:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 286 00000100:00080000:1.0:1787692435.624776:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692435.624861:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108059264 00000100:00100000:1.0:1787692435.624872:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108059264 00000100:00100000:1.0:1787692435.624939:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:1.0:1787692435.624949:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108059264:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692435.625026:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108059264:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 78us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692435.625033:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00080000:3.0:1787692435.628177:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787692435.638291:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692435.638354:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692435.638508:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108059136 00000100:00100000:2.0:1787692435.638518:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108059136 00000100:00100000:2.0:1787692435.638591:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00100000:2.0:1787692435.638614:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531108059136:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692435.638852:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf921880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+5:2362:x1874531108059136:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 250us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692435.638861:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00080000:1.0:1787692435.639188:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787692435.640015:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108059392 00000100:00100000:3.0:1787692435.640022:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108059392 00000100:00100000:3.0:1787692435.640127:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 137 00000100:00100000:3.0:1787692435.640136:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+6:2362:x1874531108059392:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692435.640207:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+6:2362:x1874531108059392:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 71us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692435.640214:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 137 00000100:00080000:1.0:1787692435.644946:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692435.863539:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692435.863844:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108059520 00000100:00100000:0.0:1787692435.863854:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108059520 00000100:00100000:0.0:1787692435.863921:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 139 00000100:00100000:0.0:1787692435.863932:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+14:11360:x1874531108059520:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692435.863950:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692435.863970:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09dec55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b242d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864029:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec5c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864043:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864063:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864078:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dec63 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864085:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dec63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864092:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dec63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864571:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec5c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864582:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec5c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864588:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864595:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692435.864599:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec5c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864607:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec5c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864620:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a200) 00010000:00010000:0.0:1787692435.864623:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692435.864628:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec5c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864639:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec5c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864649:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dec63 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864655:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dec63 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864661:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dec63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864666:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692435.864670:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dec63 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864676:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dec63 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864684:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff92ec832f4900) 00010000:00010000:0.0:1787692435.864687:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692435.864690:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dec63 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864695:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dec63 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864728:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09dec55 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b242d expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864750:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a200) 00010000:00010000:0.0:1787692435.864752:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692435.864757:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09dec55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b242d expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.864766:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0600, rc 0) 00000100:00100000:0.0:1787692435.864862:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+14:11360:x1874531108059520:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 931us (1331us total) trans 0 rc 301/301 00000100:00100000:0.0:1787692435.864869:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 139 00000100:00100000:0.0:1787692435.874142:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692435.874614:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108059776 00000100:00100000:3.0:1787692435.874635:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108059776 00000100:00100000:3.0:1787692435.874697:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 140 00000100:00100000:3.0:1787692435.874709:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+14:11360:x1874531108059776:12345-192.168.206.27@tcp:36:lfs.0 00010000:00010000:3.0:1787692435.875140:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692435.875169:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09de5d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2266 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692435.875185:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a200) 00010000:00010000:3.0:1787692435.875190:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787692435.875471:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692435.875486:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b241f expref: 5 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692435.875513:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692435.875548:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b241f expref: 5 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692435.875561:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b241f expref: 5 pid: 8193 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692435.875575:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf934000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874531125892608:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692435.875740:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a900 going to sleep for 11 seconds 00000100:00100000:3.0:1787692435.881373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692435.883003:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf934000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1874531125892608:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692435.883037:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692435.883667:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108059904 00000100:00100000:1.0:1787692435.883677:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108059904 00010000:00010000:1.0:1787692435.883713:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b241f expref: 6 pid: 8193 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692435.883799:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 62 00000100:00100000:1.0:1787692435.883809:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf133b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:749d9e33-d584-4e2f-a596-9a00b88adda5+6:2362:x1874531108059904:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787692435.883841:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692435.883849:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b241f expref: 6 pid: 8193 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692435.883862:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b241f expref: 6 pid: 8193 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692435.883883:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b241f expref: 6 pid: 8193 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692435.883920:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a200) 00010000:00010000:1.0:1787692435.883926:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692435.883935:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692435.883943:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692435.883975:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787692435.884029:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692435.884029:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf133b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2362:x1874531108059904:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 221us (2663us total) trans 0 rc 0/0 00010000:00010000:3.0:1787692435.884037:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692435.884037:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 62 00010000:00010000:3.0:1787692435.884062:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dec71 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692435.884071:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dec71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692435.884078:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dec71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692435.887096:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787692435.887113:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692435.887123:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692435.887129:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692435.887135:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692435.887140:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692435.887379:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692435.887481:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9459a200) 00010000:00010000:2.0:1787692435.887485:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692435.887491:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692435.887507:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dec6a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787692435.887528:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e8013c49 reply state 000000004ae5d916 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dec71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692435.887537:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787692435.887632:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+15:11360:x1874531108059776:12345-192.168.206.27@tcp:36:lfs.0 Request processed in 12922us (13497us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787692435.887641:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 140 00010000:00010000:2.0:1787692435.892012:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dec71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692435.892029:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dec71 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692435.892038:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dec71 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692435.892044:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692435.892049:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dec71 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692435.892056:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dec71 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692435.892071:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff92ec9459a600) 00010000:00010000:2.0:1787692435.892075:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692435.892079:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dec71 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692435.892097:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dec71 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692435.969255:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692436.001185:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692436.001259:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108060032 00000100:00100000:2.0:1787692436.001268:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108060032 00000100:00100000:2.0:1787692436.001330:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 141 00000100:00100000:2.0:1787692436.001340:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+14:11368:x1874531108060032:12345-192.168.206.27@tcp:101:lctl.0 00010000:00010000:2.0:1787692436.001362:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692436.001384:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dec78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2434 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.001445:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09dec7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.001458:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09dec7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.001467:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09dec7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692436.001525:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787692436.001541:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692436.001572:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09dec7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.001608:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dec78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2434 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.001628:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09dec7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2434 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.001649:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636c00) 00010000:00010000:2.0:1787692436.001651:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787692436.001655:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3800, rc 0) 00000100:00100000:2.0:1787692436.001716:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf922a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+15:11368:x1874531108060032:12345-192.168.206.27@tcp:101:lctl.0 Request processed in 377us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692436.001723:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 141 00000100:00100000:3.0:1787692436.090327:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692436.090404:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108060160 00000100:00100000:0.0:1787692436.090415:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108060160 00000100:00100000:0.0:1787692436.090477:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 142 00000100:00100000:0.0:1787692436.090488:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+15:11374:x1874531108060160:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1787692436.090506:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692436.090524:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dec86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b243b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.090592:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.090606:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.090615:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.090643:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09dec94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.090650:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09dec94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.090656:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09dec94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.093923:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.093946:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.093959:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692436.094014:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787692436.094018:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692436.094042:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094057:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094077:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094083:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094090:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692436.094094:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094102:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094115:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636c00) 00010000:00010000:1.0:1787692436.094118:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692436.094122:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094129:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09dec8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094145:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09dec94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094151:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09dec94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094157:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09dec94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094162:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692436.094171:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09dec94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094178:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09dec94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094186:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff92ec832f4900) 00010000:00010000:1.0:1787692436.094189:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692436.094192:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09dec94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094198:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09dec94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094238:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09dec86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b243b expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094252:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b243b expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.094258:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:1.0:1787692436.094260:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787692436.094262:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165200, rc 0) 00000100:00100000:1.0:1787692436.094350:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+16:11374:x1874531108060160:12345-192.168.206.27@tcp:101:bash.0 Request processed in 3862us (4044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692436.094358:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 142 00000100:00100000:0.0:1787692436.098279:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692436.102258:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108060416 00000100:00100000:2.0:1787692436.102273:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108060416 00000100:00100000:2.0:1787692436.102473:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 143 00000100:00100000:2.0:1787692436.102485:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+16:11374:x1874531108060416:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1787692436.102503:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692436.102522:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09deca2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2442 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.102653:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09deca9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.102667:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09deca9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.102678:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09deca9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.104445:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09decb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.104465:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09decb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.104496:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09decb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787692436.105106:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787692436.105272:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09decb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.105284:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09decb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.105293:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09decb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.105339:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09deca9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.105346:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09deca9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.105354:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09deca9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.105359:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692436.105363:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09deca9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.105371:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09deca9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.105383:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:2.0:1787692436.105386:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692436.105397:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09deca9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.105403:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09deca9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787692436.105417:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045403d9f reply state 000000009daa34cc transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09decb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692436.105427:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787692436.105462:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09deca2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2442 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.105476:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09decb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2442 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.105483:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636900) 00010000:00010000:2.0:1787692436.105486:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692436.105488:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2400, rc 0) 00000100:00100000:2.0:1787692436.105990:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+19:11374:x1874531108060416:12345-192.168.206.27@tcp:101:bash.0 Request processed in 3505us (7717us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787692436.106000:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 143 00000100:00100000:0.0:1787692436.109634:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692436.109715:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108060544 00000100:00100000:1.0:1787692436.109725:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108060544 00000100:00100000:1.0:1787692436.109801:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:1.0:1787692436.109849:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+5:2363:x1874531108060544:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1787692436.109876:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692436.109897:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036dc65eb/0x5d8b8560a09decc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2449 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787692436.109922:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787692436.109941:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1787692436.109945:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692436.109955:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036dc65eb/0x5d8b8560a09decc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2449 expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.109971:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036dc65eb/0x5d8b8560a09decc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2449 expref: 6 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.109983:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165800, rc 0) 00000100:00100000:1.0:1787692436.110029:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2363:x1874531108060544:12345-192.168.206.27@tcp:101:bash.0 Request processed in 219us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692436.110037:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 47 00010000:00010000:3.0:1787692436.110229:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09decb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.110244:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09decb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.110251:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09decb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.110257:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692436.110261:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09decb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.110268:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09decb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.110281:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec94636a00) 00010000:00010000:3.0:1787692436.110290:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692436.110294:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09decb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.110300:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09decb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692436.112237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692436.112414:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108060672 00000100:00100000:2.0:1787692436.112425:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108060672 00000100:00100000:2.0:1787692436.112488:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:2.0:1787692436.112497:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:11374:x1874531108060672:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1787692436.112513:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692436.112530:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2450 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.112579:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036dc65eb/0x5d8b8560a09decc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2449 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.112588:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692436.112592:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692436.112597:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.112630:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036dc65eb/0x5d8b8560a09decc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2449 expref: 7 pid: 6679 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.112643:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036dc65eb/0x5d8b8560a09decc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2449 expref: 7 pid: 6679 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692436.112658:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874531125892736:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692436.112754:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8133a180 going to sleep for 11 seconds 00000100:00100000:2.0:1787692436.114494:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874531125892736:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692436.114527:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.114547:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3200, rc 0) 00000100:00100000:3.0:1787692436.114596:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692436.114596:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:11374:x1874531108060672:12345-192.168.206.27@tcp:101:bash.0 Request processed in 2101us (2368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692436.114605:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:0.0:1787692436.115003:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108060800 00000100:00100000:0.0:1787692436.115011:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108060800 00010000:00010000:0.0:1787692436.115042:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036dc65eb/0x5d8b8560a09decc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2449 expref: 7 pid: 6679 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692436.115077:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:0.0:1787692436.115086:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108060800:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692436.115099:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692436.115121:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036dc65eb/0x5d8b8560a09decc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2449 expref: 7 pid: 6679 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.115133:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036dc65eb/0x5d8b8560a09decc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2449 expref: 7 pid: 6679 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.115154:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036dc65eb/0x5d8b8560a09decc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2449 expref: 7 pid: 6679 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.115181:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692436.115186:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692436.115194:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.115204:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.115235:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692436.115248:0:5816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1874531125892864:192.168.206.27@tcp:105: 00000100:00100000:0.0:1787692436.115330:0:5816:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb6eb26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692436.117067:0:5816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1874531125892864:192.168.206.27@tcp:105: 00010000:00010000:0.0:1787692436.117090:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692436.117130:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108060800:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 2044us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692436.117140:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:2.0:1787692436.123496:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692436.123689:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108061056 00000100:00100000:3.0:1787692436.123700:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108061056 00000100:00100000:3.0:1787692436.124016:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:3.0:1787692436.124028:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+18:11374:x1874531108061056:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:3.0:1787692436.124388:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+19:11374:x1874531108061056:12345-192.168.206.27@tcp:35:bash.0 Request processed in 361us (904us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1787692436.124423:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:1.0:1787692436.186309:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692436.186508:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108061312 00000100:00100000:2.0:1787692436.186520:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108061312 00000100:00100000:2.0:1787692436.186585:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 144 00000100:00100000:2.0:1787692436.186594:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+19:11384:x1874531108061312:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692436.186619:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692436.186649:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09decd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2457 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692436.186773:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787692436.187182:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09decd3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2457 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.187198:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636c00) 00010000:00010000:2.0:1787692436.187201:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787692436.187206:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09decd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2457 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.187220:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2800, rc 0) 00000100:00100000:2.0:1787692436.187408:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+20:11384:x1874531108061312:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 688us (1000us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787692436.187420:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 144 00000100:00100000:0.0:1787692436.197489:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692436.197756:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108061568 00000100:00100000:1.0:1787692436.197765:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108061568 00000100:00100000:1.0:1787692436.197850:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:1.0:1787692436.197860:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+20:11384:x1874531108061568:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:1.0:1787692436.198106:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+21:11384:x1874531108061568:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 247us (626us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1787692436.198115:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:0.0:1787692436.283342:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692436.284845:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108061696 00000100:00100000:3.0:1787692436.284858:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108061696 00000100:00100000:3.0:1787692436.285192:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 145 00000100:00100000:3.0:1787692436.285206:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+21:11390:x1874531108061696:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1787692436.285232:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692436.285253:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dece1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b245e expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.285330:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dece8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.285345:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dece8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.285356:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dece8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692436.285432:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787692436.285436:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787692436.285458:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dece8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.285485:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dece1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b245e expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.285505:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dece8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b245e expref: 22 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.285533:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:3.0:1787692436.285536:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787692436.285540:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec80031000, rc 0) 00000100:00100000:3.0:1787692436.285606:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+22:11390:x1874531108061696:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 404us (2273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692436.285614:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 145 00000100:00100000:3.0:1787692436.289672:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125893248:0@lo:400:kworker.0 00000100:00100000:1.0:1787692436.289705:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125893376:0@lo:400:kworker.0 00000100:00100000:3.0:1787692436.289751:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692436.289766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692436.289807:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787692436.289807:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787692436.289840:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125893120:0@lo:400:kworker.0 00000100:00100000:1.0:1787692436.289845:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125892992:0@lo:400:kworker.0 00000100:00100000:3.0:1787692436.289876:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692436.289888:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692436.289900:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125893632:0@lo:400:kworker.0 00000100:00100000:1.0:1787692436.289920:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125893504:0@lo:400:kworker.0 00000100:00100000:3.0:1787692436.289929:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692436.290018:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125893376 00000100:00100000:2.0:1787692436.290026:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125893376 00000100:00100000:2.0:1787692436.290075:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125893632 00000100:00100000:2.0:1787692436.290079:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125893632 00000100:00100000:2.0:1787692436.290101:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787692436.290110:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125893376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692436.290260:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125892992 00000100:00100000:0.0:1787692436.290264:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125892992 00000100:00100000:0.0:1787692436.290290:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787692436.290298:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125892992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692436.291328:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787692436.291611:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125893632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692436.292660:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692436.292695:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf920e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125893376:12345-0@lo:400:kworker.0 Request processed in 2581us (2926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692436.292707:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787692436.292723:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125893376:0@lo:400:kworker.0 00000100:00100000:0.0:1787692436.292877:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125892992:12345-0@lo:400:kworker.0 Request processed in 2577us (2987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692436.292884:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125893632:12345-0@lo:400:kworker.0 Request processed in 1542us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692436.292891:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787692436.292898:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787692436.292939:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000100:00080000:0.0:1787692436.292953:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787692436.292959:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787692436.293053:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125893248 00000100:00100000:0.0:1787692436.293059:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125893248 00000100:00100000:0.0:1787692436.293093:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125893120 00000100:00100000:0.0:1787692436.293095:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125893120 00000100:00100000:0.0:1787692436.293108:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125893504 00000100:00100000:0.0:1787692436.293110:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125893504 00000100:00100000:0.0:1787692436.293122:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787692436.293128:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125893248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692436.293164:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874531125893248:12345-0@lo:400:kworker.0 Request processed in 36us (3415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692436.293169:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787692436.293178:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787692436.293183:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125893120:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1787692436.293203:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92ecaf71ce00, transno 4294967312 00000100:00100000:0.0:1787692436.293206:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125893120:12345-0@lo:400:kworker.0 Request processed in 22us (3330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692436.293214:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787692436.293223:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125893632:0@lo:400:kworker.0 00000100:00100000:0.0:1787692436.293227:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787692436.293234:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125893504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692436.293247:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874531125893248:0@lo:400:kworker.0 00000100:00100000:0.0:1787692436.293261:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf921f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125893504:12345-0@lo:400:kworker.0 Request processed in 26us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692436.293268:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787692436.293278:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125893120:0@lo:400:kworker.0 00000100:00080000:0.0:1787692436.293282:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692436.293461:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125892992:0@lo:400:kworker.0 00000100:00100000:1.0:1787692436.293474:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125893504:0@lo:400:kworker.0 00000100:00100000:0.0:1787692436.296853:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692436.297166:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108061952 00000100:00100000:1.0:1787692436.297175:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108061952 00000100:00100000:1.0:1787692436.297225:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 146 00000100:00100000:1.0:1787692436.297234:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+22:11390:x1874531108061952:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692436.297253:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692436.297271:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09decef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2465 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.297930:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09decf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.297946:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09decf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.297957:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09decf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692436.297983:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787692436.298173:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09decef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2465 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.298190:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09decf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2465 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.298200:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636900) 00010000:00010000:1.0:1787692436.298202:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787692436.298205:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165000, rc 0) 00000100:00100000:1.0:1787692436.298255:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+24:11390:x1874531108061952:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1022us (1414us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1787692436.298263:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 146 00000100:00100000:3.0:1787692436.305611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692436.305855:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108062208 00000100:00100000:2.0:1787692436.305865:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108062208 00000100:00100000:2.0:1787692436.305929:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 147 00000100:00100000:2.0:1787692436.305939:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+24:11390:x1874531108062208:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692436.305980:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692436.306000:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09ded04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b246c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.306100:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.306113:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.306123:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692436.306135:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787692436.306241:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09ded04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b246c expref: 27 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.306258:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b246c expref: 26 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.306266:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636900) 00010000:00010000:2.0:1787692436.306269:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787692436.306283:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2a00, rc 0) 00000100:00100000:2.0:1787692436.306350:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+26:11390:x1874531108062208:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 412us (747us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787692436.306358:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 147 00000100:00100000:2.0:1787692436.313447:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692436.313497:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692436.313581:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108062464 00000100:00100000:3.0:1787692436.313591:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108062464 00000100:00100000:1.0:1787692436.313604:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108062336 00000100:00100000:1.0:1787692436.313611:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108062336 00000100:00100000:3.0:1787692436.313649:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:3.0:1787692436.313661:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108062464:12345-192.168.206.27@tcp:1:lfs.0 00010000:00010000:3.0:1787692436.313705:0:8080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.313725:0:8080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.313734:0:8080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692436.313739:0:8080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787692436.313743:0:8080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692436.313747:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:1.0:1787692436.313761:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+26:2361:x1874531108062336:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787692436.313774:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692436.313783:0:8080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.313797:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09decf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2465 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.313801:0:8080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 6 pid: 6680 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.313851:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636900) 00000100:00100000:3.0:1787692436.313852:0:8080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8080:1874531125893760:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692436.313859:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692436.315051:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+25:2361:x1874531108062336:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 1286us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692436.315062:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:3.0:1787692436.316149:0:8080:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692436.318727:0:8080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8080:1874531125893760:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692436.318757:0:8080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692436.322072:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692436.322197:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108062592 00000100:00100000:1.0:1787692436.322208:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108062592 00002000:00100000:1.0:1787692436.322254:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff92ecc5662300 x1874531108062592/t0(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:427/0 lens 504/0 e 0 to 0 dl 1787692447 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787692436.322265:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecc5662300 with x1874531108062592 ext(0->12) 00010000:00010000:1.0:1787692436.322273:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 7 pid: 6680 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.322297:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 7 pid: 6680 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787692436.322306:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ecc5662300 00000100:00100000:1.0:1787692436.322340:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:1.0:1787692436.322351:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108062592:12345-192.168.206.27@tcp:4:lfs.0 00000100:00100000:1.0:1787692436.322844:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5662300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:067f46f5-4779-40e6-b53d-5b3e89751501+9:2361:x1874531108062592:12345-192.168.206.27@tcp:4:lfs.0 Request processed in 493us (780us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787692436.322853:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00002000:00100000:1.0:1787692436.322860:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff92ecc5662300 x1874531108062592/t4294967305(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:427/0 lens 504/448 e 0 to 0 dl 1787692447 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787692436.322868:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecc5662300 with x1874531108062592 ext(0->12) 00010000:00010000:1.0:1787692436.322875:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 9 pid: 6680 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.322887:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 9 pid: 6680 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787692436.322905:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ecc5662300 00000100:00100000:1.0:1787692436.326095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692436.326448:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108062720 00000100:00100000:0.0:1787692436.326458:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108062720 00010000:00010000:0.0:1787692436.326499:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 9 pid: 6680 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692436.326586:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:0.0:1787692436.326596:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf923480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+9:2362:x1874531108062720:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692436.326613:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787692436.326632:0:5818:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787692436.326635:0:5818:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787692435 00002000:00010000:0.0:1787692436.326638:0:5818:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787692436 00002000:00010000:0.0:1787692436.326640:0:5818:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787692435 00010000:00010000:0.0:1787692436.326646:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 9 pid: 6680 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.326659:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 9 pid: 6680 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.326680:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008accfefd/0x5d8b8560a09deccc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2450 expref: 9 pid: 6680 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.326697:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787692436.326701:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787692436.326707:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.326736:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.326773:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692436.326852:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf923480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+8:2362:x1874531108062720:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 257us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692436.326859:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 64 00010000:00010000:2.0:1787692436.326933:0:8080:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.326943:0:8080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.326977:0:8080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.326985:0:8080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.326993:0:8080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.327000:0:8080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692436.327005:0:8080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.327015:0:8080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.327036:0:8080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.327044:0:8080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be7b3415/0x5d8b8560a09ded19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692436.327091:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf934000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:2362:x1874531108062464:12345-192.168.206.27@tcp:1:lfs.0 Request processed in 13434us (13593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692436.327099:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:2.0:1787692436.332077:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692436.332168:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108062976 00000100:00100000:1.0:1787692436.332181:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108062976 00000100:00100000:1.0:1787692436.332276:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:1.0:1787692436.332299:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83552050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+25:11390:x1874531108062976:12345-192.168.206.27@tcp:35:lfs.0 00000004:00010000:1.0:1787692436.332373:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b246c expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787692436.332677:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1787692436.332727:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1787692436.333339:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1787692436.333399:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.333414:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09decb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2442 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.333424:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.333458:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09decb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2442 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.333473:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09decb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2442 expref: 29 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692436.333507:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874531125893888:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692436.333584:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692436.336404:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692436.336539:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874531125893888:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692436.336566:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692436.336618:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108063104 00000100:00100000:2.0:1787692436.336625:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108063104 00010000:00010000:2.0:1787692436.336661:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09decb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2442 expref: 30 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692436.336701:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 65 00000100:00100000:2.0:1787692436.336712:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+30:2361:x1874531108063104:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692436.336727:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692436.336734:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09decb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2442 expref: 30 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.336746:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09decb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2442 expref: 30 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.336767:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09decb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2442 expref: 30 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.336796:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636900) 00010000:00010000:2.0:1787692436.336800:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.336810:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.336849:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.336873:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692436.336932:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+29:2361:x1874531108063104:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 221us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692436.336939:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 65 00010000:00010000:0.0:1787692436.337024:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.337031:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787692436.337148:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787692436.337381:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787692436.337501:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874531125894016:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787692436.337551:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692436.337589:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb6eb2240 going to sleep for 11 seconds 00000100:00100000:2.0:1787692436.338023:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125894016 00000100:00100000:2.0:1787692436.338031:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125894016 00000100:00100000:2.0:1787692436.338071:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787692436.338079:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874531125894016:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787692436.338156:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874531125894016:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 77us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692436.338163:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787692436.338307:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874531125894016:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787692436.338958:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1787692436.339030:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874531125894144:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787692436.339082:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692436.339107:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9046ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787692436.339126:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125894144 00000100:00100000:3.0:1787692436.339130:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125894144 00000100:00100000:3.0:1787692436.339157:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787692436.339163:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1874531125894144:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787692436.339308:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1874531125894144:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 144us (226us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787692436.339328:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787692436.339364:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874531125894144:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787692436.339408:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787692436.339442:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.339451:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.339458:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.339464:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692436.339468:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.339486:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.339501:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636900) 00010000:00010000:3.0:1787692436.339504:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787692436.339508:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.339515:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09ded20 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787692436.339672:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787692436.339789:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1787692436.339799:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 342545986148ns, next at 343545984468ns, rc = 0 00000001:00080000:3.0:1787692436.339806:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1787692436.339861:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636900) 00010000:00010000:3.0:1787692436.339864:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787692436.339870:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b246c expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692436.339959:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83552050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+32:11390:x1874531108062976:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 7674us (7892us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1787692436.339967:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 38 00000020:00080000:3.0:1787692436.339972:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787692436.343601:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692436.343690:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108063232 00000100:00100000:0.0:1787692436.343700:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108063232 00000100:00100000:0.0:1787692436.343766:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 148 00000100:00100000:0.0:1787692436.343777:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+32:11390:x1874531108063232:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692436.343853:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692436.343881:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09ded27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2473 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.344030:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09ded27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2473 expref: 33 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.344044:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09ded27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2473 expref: 33 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.344063:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:0.0:1787692436.344066:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787692436.344070:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1000, rc 0) 00000100:00100000:0.0:1787692436.344214:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+33:11390:x1874531108063232:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 437us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692436.344221:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 148 00000100:00100000:3.0:1787692436.346532:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692436.346586:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108063488 00000100:00100000:0.0:1787692436.346598:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108063488 00000100:00100000:0.0:1787692436.346653:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:0.0:1787692436.346663:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+33:11390:x1874531108063488:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:0.0:1787692436.346909:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+34:11390:x1874531108063488:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 246us (384us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787692436.346916:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:3.0:1787692436.435170:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692436.435370:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108063744 00000100:00100000:1.0:1787692436.435379:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108063744 00000100:00100000:1.0:1787692436.435455:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 149 00000100:00100000:1.0:1787692436.435466:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+34:11400:x1874531108063744:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692436.435493:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692436.435517:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09ded2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b247a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692436.435621:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787692436.435729:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09ded2e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b247a expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.435744:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636c00) 00010000:00010000:1.0:1787692436.435747:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787692436.435752:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09ded2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b247a expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692436.435766:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165c00, rc 0) 00000100:00100000:1.0:1787692436.435879:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+35:11400:x1874531108063744:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 414us (719us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787692436.435886:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 149 00000100:00100000:1.0:1787692436.439577:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692436.439668:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108063872 00000100:00100000:2.0:1787692436.439678:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108063872 00000100:00100000:2.0:1787692436.439743:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 150 00000100:00100000:2.0:1787692436.439754:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+35:11400:x1874531108063872:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:2.0:1787692436.439880:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09ded3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.439934:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09ded3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.439945:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09ded3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.439963:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.439981:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.439988:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440095:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09ded4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440104:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09ded4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440111:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09ded4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787692436.440154:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09ded4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440168:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09ded3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440175:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09ded3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440193:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09ded3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440200:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692436.440205:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09ded3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440213:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09ded3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440228:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:2.0:1787692436.440231:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692436.440236:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09ded3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440243:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09ded3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440257:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440264:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440269:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440273:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692436.440276:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440306:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440326:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec94636300) 00010000:00010000:2.0:1787692436.440328:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692436.440332:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440338:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440354:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09ded4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440361:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09ded4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440367:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09ded4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440373:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692436.440376:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09ded4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440382:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09ded4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.440390:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:2.0:1787692436.441070:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692436.441076:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09ded4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.441097:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09ded4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692436.441177:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+35:11400:x1874531108063872:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 1422us (1608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692436.441187:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 150 00000100:00100000:0.0:1787692436.444722:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692436.444849:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108064128 00000100:00100000:3.0:1787692436.444859:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108064128 00000100:00100000:3.0:1787692436.444941:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:3.0:1787692436.444952:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+35:11400:x1874531108064128:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:3.0:1787692436.445365:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+36:11400:x1874531108064128:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 414us (653us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1787692436.445374:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:3.0:1787692436.485536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692436.485649:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108064384 00000100:00100000:0.0:1787692436.485659:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108064384 00000100:00100000:0.0:1787692436.485717:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 151 00000100:00100000:0.0:1787692436.485742:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+36:11403:x1874531108064384:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692436.485767:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692436.485786:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09ded51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2481 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.485914:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.485927:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.485937:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.485951:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09ded5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.485957:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09ded5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.485964:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09ded5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486094:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09ded66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486102:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09ded66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486110:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09ded66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692436.486130:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787692436.486225:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486233:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486239:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486245:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692436.486250:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486257:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486268:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:0.0:1787692436.486271:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692436.486276:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486282:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486306:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09ded5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486322:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09ded5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486341:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09ded5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486347:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692436.486351:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09ded5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486356:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09ded5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486363:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692436.486366:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692436.486368:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09ded5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486374:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09ded5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486415:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09ded51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2481 expref: 39 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486429:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09ded66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2481 expref: 38 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.486449:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:0.0:1787692436.486452:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692436.486454:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0c00, rc 0) 00000100:00100000:0.0:1787692436.486520:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+38:11403:x1874531108064384:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 781us (992us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787692436.486535:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 151 00000100:00100000:1.0:1787692436.490230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692436.490452:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108064512 00000100:00100000:3.0:1787692436.490462:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108064512 00000100:00100000:3.0:1787692436.490592:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 152 00000100:00100000:3.0:1787692436.490605:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+38:11403:x1874531108064512:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:3.0:1787692436.490671:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09ded74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.490687:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09ded74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.490698:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09ded74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.490723:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09ded74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.490730:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09ded74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.490736:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09ded74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.490742:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692436.490746:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09ded74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.490767:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09ded74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.490779:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:3.0:1787692436.490782:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787692436.490786:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09ded74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.490792:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09ded74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692436.490907:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+38:11403:x1874531108064512:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 305us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692436.490916:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 152 00000100:00100000:0.0:1787692436.493111:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692436.493377:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108064768 00000100:00100000:3.0:1787692436.493388:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108064768 00000100:00100000:3.0:1787692436.493444:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:3.0:1787692436.493454:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+38:11403:x1874531108064768:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:3.0:1787692436.493751:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+39:11403:x1874531108064768:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 297us (648us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1787692436.493759:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:0.0:1787692436.759637:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692436.759785:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108065024 00000100:00100000:2.0:1787692436.759795:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108065024 00000100:00100000:2.0:1787692436.759894:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 153 00000100:00100000:2.0:1787692436.759905:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+39:11434:x1874531108065024:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:2.0:1787692436.759938:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692436.759957:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09ded7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2488 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.760140:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.760154:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.760166:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692436.760176:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787692436.760298:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09ded7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2488 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.760330:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2488 expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.760348:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:2.0:1787692436.760353:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692436.760356:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2a00, rc 0) 00000100:00100000:2.0:1787692436.760422:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf915180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+41:11434:x1874531108065024:12345-192.168.206.27@tcp:101:cat.0 Request processed in 518us (795us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787692436.760429:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 153 00000100:00100000:1.0:1787692436.772203:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692436.772567:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692436.773392:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108065280 00000100:00100000:3.0:1787692436.773407:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108065280 00000100:00100000:3.0:1787692436.773495:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:3.0:1787692436.773509:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+41:11434:x1874531108065280:12345-192.168.206.27@tcp:35:cat.0 00000100:00100000:0.0:1787692436.773611:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108065408 00000100:00100000:0.0:1787692436.773618:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108065408 00000100:00100000:0.0:1787692436.773740:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:0.0:1787692436.773748:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+42:2361:x1874531108065408:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692436.773762:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692436.773793:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09ded82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2488 expref: 43 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.773871:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:0.0:1787692436.773883:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692436.773959:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+42:2361:x1874531108065408:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 211us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692436.774164:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:3.0:1787692436.775130:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+41:11434:x1874531108065280:12345-192.168.206.27@tcp:35:cat.0 Request processed in 1617us (2934us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1787692436.775169:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:3.0:1787692436.802902:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125894272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692436.803014:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692436.803235:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125894272 00000100:00100000:0.0:1787692436.803246:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125894272 00000100:00100000:0.0:1787692436.803426:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787692436.803439:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125894272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787692436.803506:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692436.803582:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125894272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692436.803590:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787692436.803733:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125894272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787692436.834115:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692436.843687:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108065664 00000100:00100000:0.0:1787692436.843712:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108065664 00000100:00100000:0.0:1787692436.843848:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 154 00000100:00100000:0.0:1787692436.843862:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+41:11440:x1874531108065664:12345-192.168.206.27@tcp:101:dd.0 00010000:00010000:0.0:1787692436.843898:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692436.843902:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787692436.843944:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dece8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b245e expref: 41 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.844198:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:0.0:1787692436.844207:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787692436.844228:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09ded90 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b248f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.844363:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.844379:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09ded66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2481 expref: 41 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.844388:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.844596:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09ded66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2481 expref: 41 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.844615:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09ded66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2481 expref: 41 pid: 8461 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692436.844631:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf914000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125894400:192.168.206.27@tcp:104: 00000100:00100000:0.0:1787692436.844882:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8133a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787692436.857555:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692436.857770:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf914000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125894400:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692436.857807:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692436.857994:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108065792 00000100:00100000:2.0:1787692436.858004:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108065792 00010000:00010000:2.0:1787692436.858050:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09ded66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2481 expref: 42 pid: 8461 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692436.858092:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 66 00000100:00100000:2.0:1787692436.858102:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+42:2361:x1874531108065792:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692436.858120:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692436.858127:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09ded66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2481 expref: 42 pid: 8461 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.858140:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09ded66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2481 expref: 42 pid: 8461 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.858165:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09ded66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2481 expref: 42 pid: 8461 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.858183:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:2.0:1787692436.858189:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.858216:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.858224:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.858249:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692436.858391:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf914380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+41:2361:x1874531108065792:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 289us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692436.858400:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 66 00010000:00010000:0.0:1787692436.858519:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.858528:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692436.858551:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787692436.858771:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09ded90 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b248f expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.858789:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b248f expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.859168:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:0.0:1787692436.859172:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787692436.859175:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1c00, rc 0) 00000100:00100000:1.0:1787692436.866018:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+41:11440:x1874531108065664:12345-192.168.206.27@tcp:101:dd.0 Request processed in 22142us (31904us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1787692436.866034:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 154 00000100:00100000:0.0:1787692436.877542:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692436.877729:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108066048 00000100:00100000:3.0:1787692436.877742:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108066048 00000100:00100000:3.0:1787692436.877867:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 155 00000100:00100000:3.0:1787692436.877881:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+41:11440:x1874531108066048:12345-192.168.206.27@tcp:36:dd.0 00010000:00010000:3.0:1787692436.878215:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deda5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.878237:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deda5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692436.878252:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deda5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787692436.878327:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1787692436.878352:0:8193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051f1521b reply state 00000000d43485c7 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deda5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692436.878362:0:8193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787692436.878475:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf914e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+44:11440:x1874531108066048:12345-192.168.206.27@tcp:36:dd.0 Request processed in 596us (949us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787692436.878492:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 155 00000020:00080000:3.0:1787692436.878498:0:8193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787692436.882000:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deda5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.882023:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deda5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.882033:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deda5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.882040:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692436.882047:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deda5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.882056:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deda5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.882078:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:2.0:1787692436.882082:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692436.882086:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deda5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692436.882117:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09deda5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692436.993759:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692437.139279:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692437.139597:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108066176 00000100:00100000:3.0:1787692437.139612:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108066176 00000100:00100000:3.0:1787692437.139852:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 156 00000100:00100000:3.0:1787692437.139870:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+43:11454:x1874531108066176:12345-192.168.206.27@tcp:101:stat.0 00010000:00010000:3.0:1787692437.139912:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692437.139949:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dedac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2496 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.140055:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dedb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.140072:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dedb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.140085:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dedb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.140101:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dedba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.140119:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dedba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.140127:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dedba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.140254:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dedc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.140267:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b248f expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.140276:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dedc1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.140341:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b248f expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.140359:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b248f expref: 44 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692437.140376:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125894528:192.168.206.27@tcp:104: 00000100:00080000:0.0:1787692437.142000:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692437.143640:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb6eb2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787692437.146689:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125894528:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692437.146735:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dedc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692437.152701:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692437.153114:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108066432 00000100:00100000:1.0:1787692437.153128:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108066432 00000100:00100000:1.0:1787692437.153218:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:1.0:1787692437.153231:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+45:5599:x1874531108066432:12345-192.168.206.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787692437.153723:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+46:5599:x1874531108066432:12345-192.168.206.27@tcp:35:ldlm_bl.0 Request processed in 493us (1036us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787692437.153733:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:0.0:1787692437.157650:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692437.157762:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108066560 00000100:00100000:2.0:1787692437.157775:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108066560 00010000:00010000:2.0:1787692437.157860:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b248f expref: 46 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692437.157916:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 67 00000100:00100000:2.0:1787692437.157929:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf915f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+46:2362:x1874531108066560:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692437.157950:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692437.157958:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b248f expref: 46 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.157983:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b248f expref: 46 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.158011:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09ded97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b248f expref: 46 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.158030:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:2.0:1787692437.158037:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dedc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.158049:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dedc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.158057:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dedc1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.158123:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692437.158214:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf915f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+45:2362:x1874531108066560:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 286us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692437.158223:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 67 00010000:00010000:3.0:1787692437.158491:0:8461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dedc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158501:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dedc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692437.158561:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787692437.158567:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787692437.158592:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dedc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158608:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dedc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158621:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dedb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158643:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dedb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158651:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dedb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158658:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692437.158663:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dedb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158672:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dedb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158685:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:3.0:1787692437.158688:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692437.158693:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dedb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158699:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09dedb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158716:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dedba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158723:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dedba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158729:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dedba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158733:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692437.158743:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dedba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158749:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dedba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158757:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec9459af00) 00010000:00010000:3.0:1787692437.158759:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692437.158763:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dedba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158768:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09dedba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158869:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dedac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2496 expref: 45 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158885:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dedc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2496 expref: 44 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.158893:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:3.0:1787692437.158896:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787692437.158898:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec80031600, rc 0) 00000100:00100000:3.0:1787692437.158937:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf914700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+44:11454:x1874531108066176:12345-192.168.206.27@tcp:101:stat.0 Request processed in 19074us (19674us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692437.158945:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 156 00000100:00100000:2.0:1787692437.240517:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692437.244024:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108066816 00000100:00100000:1.0:1787692437.244044:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108066816 00000100:00100000:1.0:1787692437.244216:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 157 00000100:00100000:1.0:1787692437.244231:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+44:11460:x1874531108066816:12345-192.168.206.27@tcp:36:truncate.0 00010000:00010000:1.0:1787692437.244328:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692437.244361:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09dedc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2496 expref: 44 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.244410:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:1.0:1787692437.244416:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787692437.244683:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09dedc8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.244711:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09dedc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.244723:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09dedc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787692437.244787:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1787692437.244875:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d6c2e22f reply state 000000008d4fe0f6 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09dedc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692437.244887:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787692437.245019:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+46:11460:x1874531108066816:12345-192.168.206.27@tcp:36:truncate.0 Request processed in 790us (4516us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1787692437.245029:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 157 00000020:00080000:1.0:1787692437.245036:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787692437.251147:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09dedc8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.251172:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09dedc8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.251199:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09dedc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.251206:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692437.251212:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09dedc8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.251221:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09dedc8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.251243:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:3.0:1787692437.251247:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692437.251252:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09dedc8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.251259:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164c00/0x5d8b8560a09dedc8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787692437.401735:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000001:00080000:3.0:1787692437.401774:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000004:00080000:3.0:1787692437.401858:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787692437.401885:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92ec9046a300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787692437.401891:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ecaef65300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92ec9046a6c0 00000020:00080000:3.0:1787692437.401894:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ecaef65800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92ecb4d31800 00000100:00100000:1.0:1787692437.402124:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecc5662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125894656:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787692437.402212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692437.402265:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125894656 00000100:00100000:2.0:1787692437.402275:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125894656 00000100:00100000:2.0:1787692437.402407:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787692437.402419:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874531125894656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787692437.402456:0:6679:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1787692437.402498:0:6679:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8e0593, atime: 0x6a8e0594, ctime: 0x6a8e0593, blocks: 0x1 00010000:00010000:2.0:1787692437.402508:0:6679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09dedcf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.402529:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1787692437.402534:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692437.402542:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09dedcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.402561:0:6679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09dedcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.402572:0:6679:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09dedcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.402580:0:6679:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09dedcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.402663:0:6679:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787692437.402766:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692437.402774:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09dedcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.402783:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2400 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692437.402788:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09dedcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.402805:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09dedcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.402858:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09dedcf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.402866:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063888c7f/0x5d8b8560a09dedcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.402959:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692437.402962:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692437.402964:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1787692437.404862:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:2.0:1787692437.405258:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1874531125894656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2781us (2986us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787692437.405275:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000020:00080000:0.0:1787692437.405527:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000004:00080000:1.0:1787692437.414867:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92ecc5662a00/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787692437.416016:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecc5662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125894656:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787692437.466645:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692437.466928:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108066944 00000100:00100000:0.0:1787692437.466940:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108066944 00000100:00100000:0.0:1787692437.467017:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 158 00000100:00100000:0.0:1787692437.467029:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+15:11474:x1874531108066944:12345-192.168.206.27@tcp:101:stat.0 00010000:00010000:0.0:1787692437.467084:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692437.467112:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09dedd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b249d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.467204:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09deddd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.467221:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09deddd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.467233:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09deddd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.467251:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09dede4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.467258:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09dede4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.467265:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09dede4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.468920:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dedeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.468939:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dedeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.468951:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dedeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692437.469005:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787692437.469019:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692437.469057:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dedeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469072:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dedeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469083:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09deddd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469089:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09deddd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469096:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09deddd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469102:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692437.469107:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09deddd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469115:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09deddd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469131:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:0.0:1787692437.469135:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692437.469140:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09deddd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469146:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09deddd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469160:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09dede4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469175:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09dede4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469181:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09dede4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469186:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692437.469189:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09dede4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469195:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09dede4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469204:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692437.469206:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692437.469209:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09dede4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469215:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09dede4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469265:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09dedd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b249d expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469282:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dedeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b249d expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.469290:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:0.0:1787692437.469292:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692437.469304:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0400, rc 0) 00000100:00100000:0.0:1787692437.469416:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+16:11474:x1874531108066944:12345-192.168.206.27@tcp:101:stat.0 Request processed in 2388us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692437.469426:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 158 00000100:00100000:1.0:1787692437.588222:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692437.588425:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108067200 00000100:00100000:0.0:1787692437.588439:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108067200 00000100:00100000:0.0:1787692437.588577:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 159 00000100:00100000:0.0:1787692437.588591:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+16:11484:x1874531108067200:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692437.588621:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692437.588649:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09dedf2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24a4 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692437.589036:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787692437.589316:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09dedf2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24a4 expref: 18 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.589335:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636c00) 00010000:00010000:0.0:1787692437.589338:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787692437.589344:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09dedf2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24a4 expref: 18 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.589359:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0200, rc 0) 00000100:00100000:0.0:1787692437.589432:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+17:11484:x1874531108067200:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 845us (1232us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1787692437.589439:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 159 00000100:00100000:1.0:1787692437.594350:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692437.594465:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108067456 00000100:00100000:2.0:1787692437.594479:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108067456 00000100:00100000:2.0:1787692437.594551:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:2.0:1787692437.594565:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83553850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+17:11484:x1874531108067456:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1787692437.595337:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83553850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+18:11484:x1874531108067456:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 769us (996us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787692437.595350:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:2.0:1787692437.681879:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692437.682059:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108067712 00000100:00100000:1.0:1787692437.682072:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108067712 00000100:00100000:1.0:1787692437.682146:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 160 00000100:00100000:1.0:1787692437.682160:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+18:11490:x1874531108067712:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1787692437.682192:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692437.682223:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09dee00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24ab expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.682371:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.682405:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dedeb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b249d expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.682415:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.682459:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dedeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b249d expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.682624:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dedeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b249d expref: 19 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692437.682642:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125894784:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692437.682853:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfb240 going to sleep for 11 seconds 00000100:00100000:1.0:1787692437.689865:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692437.689972:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108067840 00000100:00100000:3.0:1787692437.689982:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108067840 00000100:00100000:2.0:1787692437.690000:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2df480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125894784:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692437.690038:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.690039:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dedeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b249d expref: 20 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692437.690109:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:3.0:1787692437.690121:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+20:2362:x1874531108067840:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692437.690140:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692437.690148:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dedeb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b249d expref: 20 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.690161:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dedeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b249d expref: 20 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.690186:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09dedeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b249d expref: 20 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.690408:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:3.0:1787692437.690415:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.690426:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.690434:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.690464:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692437.690581:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+19:2362:x1874531108067840:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 461us (765us total) trans 0 rc 0/0 00010000:00010000:2.0:1787692437.690586:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692437.690590:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 68 00010000:00010000:2.0:1787692437.690594:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692437.690617:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787692437.690847:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09dee00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ab expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.690881:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ab expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.690889:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:2.0:1787692437.690892:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787692437.690895:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165800, rc 0) 00000100:00100000:2.0:1787692437.690925:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+19:11490:x1874531108067712:12345-192.168.206.27@tcp:101:bash.0 Request processed in 8769us (9116us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787692437.690933:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 160 00000100:00100000:0.0:1787692437.698953:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692437.700613:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108068096 00000100:00100000:2.0:1787692437.700633:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108068096 00000100:00100000:2.0:1787692437.700724:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 161 00000100:00100000:2.0:1787692437.700738:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+19:11490:x1874531108068096:12345-192.168.206.27@tcp:36:bash.0 00010000:00010000:2.0:1787692437.701132:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.701154:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.701167:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787692437.701232:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787692437.701263:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000531c1c0b reply state 0000000023f93696 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692437.701273:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787692437.701420:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf917480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+22:11490:x1874531108068096:12345-192.168.206.27@tcp:36:bash.0 Request processed in 684us (2481us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787692437.701429:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 161 00000020:00080000:2.0:1787692437.701435:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787692437.704392:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.704416:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.704424:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.704431:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692437.704437:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.704446:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.704466:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:2.0:1787692437.704487:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692437.704493:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.704499:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692437.708634:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692437.713049:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108068224 00000100:00100000:1.0:1787692437.713070:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108068224 00000100:00100000:1.0:1787692437.713216:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 162 00000100:00100000:1.0:1787692437.713229:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+21:11490:x1874531108068224:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1787692437.713263:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692437.713302:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09dee1c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24b2 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.713439:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09dee23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.713458:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ab expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.713489:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09dee23 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.713534:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ab expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.713551:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ab expref: 22 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692437.713568:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2df800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125894912:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692437.713940:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfb180 going to sleep for 11 seconds 00000100:00100000:1.0:1787692437.717082:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692437.717181:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108068352 00000100:00100000:2.0:1787692437.717195:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108068352 00010000:00010000:2.0:1787692437.717262:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ab expref: 23 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692437.717393:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:2.0:1787692437.717407:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+23:2361:x1874531108068352:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692437.717428:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692437.717438:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ab expref: 23 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.717453:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ab expref: 23 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.717481:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:2.0:1787692437.717487:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09dee23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.717498:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09dee23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.717506:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09dee23 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.717532:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692437.717604:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+23:2361:x1874531108068352:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 200us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692437.717612:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 69 00010000:00010000:0.0:1787692437.717770:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09dee07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ab expref: 22 pid: 5833 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692437.717801:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2df800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125894912:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692437.717873:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09dee23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.717896:0:8461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09dee23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.717903:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09dee23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692437.717961:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787692437.717966:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692437.717992:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09dee23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.718030:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09dee1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24b2 expref: 22 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.718047:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09dee23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24b2 expref: 21 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692437.718054:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:0.0:1787692437.718057:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692437.718060:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164e00, rc 0) 00000100:00100000:0.0:1787692437.718094:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf915c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+21:11490:x1874531108068224:12345-192.168.206.27@tcp:101:bash.0 Request processed in 4868us (9477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692437.718102:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 162 00000100:00100000:3.0:1787692437.723614:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692437.723761:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108068608 00000100:00100000:2.0:1787692437.723775:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108068608 00000100:00100000:2.0:1787692437.724073:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:2.0:1787692437.724087:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+21:11490:x1874531108068608:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:2.0:1787692437.724414:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+22:11490:x1874531108068608:12345-192.168.206.27@tcp:35:bash.0 Request processed in 330us (815us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1787692437.724424:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:1.0:1787692437.805797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692437.812531:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108068864 00000100:00100000:2.0:1787692437.812571:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108068864 00000100:00100000:2.0:1787692437.812686:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 163 00000100:00100000:2.0:1787692437.812700:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+22:11500:x1874531108068864:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692437.812739:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692437.812767:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24b9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692437.813158:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1787692437.813379:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee2a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24b9 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.813396:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636c00) 00010000:00010000:2.0:1787692437.813400:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787692437.813407:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24b9 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.813423:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2800, rc 0) 00000100:00100000:2.0:1787692437.813526:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+23:11500:x1874531108068864:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 828us (7742us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787692437.813535:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 163 00000100:00100000:1.0:1787692437.821089:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692437.821390:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108068992 00000100:00100000:2.0:1787692437.821403:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108068992 00000100:00100000:2.0:1787692437.821487:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 164 00000100:00100000:2.0:1787692437.821500:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+23:11500:x1874531108068992:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:2.0:1787692437.821607:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee38 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.821626:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.821644:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.821662:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.821669:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.821675:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.822273:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dee46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.822887:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dee46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.822898:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dee46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787692437.823204:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dee46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823221:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823227:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee38 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823234:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823241:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692437.823246:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823253:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee38 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823269:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:3.0:1787692437.823273:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692437.823623:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823633:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823673:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823679:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823685:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823690:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692437.823693:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823700:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823709:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec94636a00) 00010000:00010000:3.0:1787692437.823711:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692437.823714:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823720:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823740:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dee46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823746:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dee46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823752:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dee46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823762:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692437.823765:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dee46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.823771:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dee46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.824138:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:3.0:1787692437.824140:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692437.824144:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dee46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.824150:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09dee46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692437.824290:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+23:11500:x1874531108068992:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 2781us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692437.824301:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 164 00000100:00100000:3.0:1787692437.832735:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecc5663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125895040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787692437.832884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692437.833114:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125895040 00000100:00100000:3.0:1787692437.833125:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125895040 00000100:00100000:3.0:1787692437.833181:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787692437.833192:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874531125895040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787692437.833236:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692437.833292:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1874531125895040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692437.833300:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787692437.833389:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecc5663100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125895040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692437.841211:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692437.847872:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108069248 00000100:00100000:3.0:1787692437.847893:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108069248 00000100:00100000:3.0:1787692437.847981:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:3.0:1787692437.847996:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+23:11500:x1874531108069248:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:3.0:1787692437.849029:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+24:11500:x1874531108069248:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 926us (7721us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1787692437.849044:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 46 00000001:00080000:0.0:1787692437.891074:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1787692437.892405:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:0.0:1787692437.910027:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692437.910192:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108069504 00000100:00100000:1.0:1787692437.910204:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108069504 00000100:00100000:1.0:1787692437.910282:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 165 00000100:00100000:1.0:1787692437.910293:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+24:11503:x1874531108069504:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692437.910333:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692437.910360:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dee4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24c0 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.913592:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.913631:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.913648:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.913679:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.913687:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.913716:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.916145:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.916171:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.916184:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692437.916198:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787692437.918095:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.918118:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.918126:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.918133:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692437.918138:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.918146:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.918166:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:2.0:1787692437.918169:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692437.918195:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.918203:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.918227:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.918232:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.918237:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.918242:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692437.918245:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.918251:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.918260:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec94636100) 00010000:00010000:2.0:1787692437.918262:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692437.918265:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.918270:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09dee5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.919148:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dee4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24c0 expref: 27 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.919190:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24c0 expref: 26 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692437.919201:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:2.0:1787692437.919204:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692437.919207:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2800, rc 0) 00000100:00100000:2.0:1787692437.920192:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf916300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+26:11503:x1874531108069504:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 9892us (10268us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787692437.920207:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 165 00000100:00100000:2.0:1787692437.948151:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692437.948323:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692437.949069:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108069632 00000100:00100000:3.0:1787692437.949083:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108069632 00000100:00100000:3.0:1787692437.949184:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:3.0:1787692437.949197:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5661500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+26:2361:x1874531108069632:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692437.949218:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692437.949251:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09dee62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24c0 expref: 26 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692437.949276:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:3.0:1787692437.949282:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692437.949368:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5661500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+25:2361:x1874531108069632:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 175us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692437.949376:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:1.0:1787692437.953587:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108069760 00000100:00100000:1.0:1787692437.953610:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108069760 00000100:00100000:1.0:1787692437.953764:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 166 00000100:00100000:1.0:1787692437.953778:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+25:11503:x1874531108069760:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:1.0:1787692437.953946:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dee70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.953969:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dee70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.953982:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dee70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.954018:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dee70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.954026:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dee70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.954034:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dee70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.954042:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692437.954048:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dee70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.954056:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dee70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.954070:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:1.0:1787692437.954074:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787692437.954079:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dee70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692437.954086:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09dee70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692437.954195:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+25:11503:x1874531108069760:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 420us (6059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692437.954203:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 166 00000100:00100000:2.0:1787692437.960556:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692437.960662:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108070016 00000100:00100000:3.0:1787692437.960675:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108070016 00000100:00100000:3.0:1787692437.960762:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:3.0:1787692437.960777:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+25:11503:x1874531108070016:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:3.0:1787692437.961190:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+26:11503:x1874531108070016:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 415us (648us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1787692437.961214:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 47 00010000:00010000:2.0:1787692438.017159:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692438.087801:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692438.088069:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108070272 00000100:00100000:0.0:1787692438.088082:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108070272 00000100:00100000:0.0:1787692438.088164:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 167 00000100:00100000:0.0:1787692438.088177:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+26:11521:x1874531108070272:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:0.0:1787692438.088210:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692438.088245:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09dee77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24c7 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.088398:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09dee7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.088415:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09dee7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.088428:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09dee7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692438.088440:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787692438.088599:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09dee77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24c7 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.088622:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09dee7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24c7 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.088632:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:0.0:1787692438.088658:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787692438.088662:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1800, rc 0) 00000100:00100000:0.0:1787692438.088963:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+28:11521:x1874531108070272:12345-192.168.206.27@tcp:101:cat.0 Request processed in 788us (1175us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1787692438.088971:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 167 00000100:00100000:0.0:1787692438.112137:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692438.112984:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108070400 00000100:00100000:2.0:1787692438.113001:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108070400 00000100:00100000:2.0:1787692438.114480:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 168 00000100:00100000:2.0:1787692438.114505:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+28:11522:x1874531108070400:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692438.114544:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692438.114572:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24ce expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.114660:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09dee93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.114676:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09dee93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.114711:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09dee93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692438.114983:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787692438.114988:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692438.115066:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09dee93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.115098:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ce expref: 30 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.115120:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09dee93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ce expref: 29 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.115130:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:2.0:1787692438.115133:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787692438.115138:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3a00, rc 0) 00000100:00100000:2.0:1787692438.115231:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf914a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+29:11522:x1874531108070400:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 737us (3109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692438.115240:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 168 00000100:00100000:2.0:1787692438.124803:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692438.125967:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108070784 00000100:00100000:3.0:1787692438.125985:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108070784 00000100:00100000:3.0:1787692438.126065:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:3.0:1787692438.126081:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+29:11522:x1874531108070784:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:3.0:1787692438.126599:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+30:11522:x1874531108070784:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 520us (1808us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787692438.126610:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:3.0:1787692438.131186:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692438.131315:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108070912 00000100:00100000:0.0:1787692438.131328:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108070912 00000100:00100000:0.0:1787692438.131411:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:0.0:1787692438.131421:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+30:11522:x1874531108070912:12345-192.168.206.27@tcp:103:lfs.0 00010000:00010000:0.0:1787692438.131440:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787692438.131476:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09dee23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24b2 expref: 30 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.131504:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09dee7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24c7 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.131519:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09ded27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2473 expref: 28 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.131531:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:0.0:1787692438.131544:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692438.131621:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+27:11522:x1874531108070912:12345-192.168.206.27@tcp:103:lfs.0 Request processed in 201us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692438.131630:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:1.0:1787692438.136158:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692438.136346:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108071040 00000100:00100000:2.0:1787692438.136358:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108071040 00000100:00100000:2.0:1787692438.136483:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 169 00000100:00100000:2.0:1787692438.136495:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+27:11522:x1874531108071040:12345-192.168.206.27@tcp:58:lfs.0 00010000:00010000:2.0:1787692438.136623:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.136663:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.136676:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787692438.137527:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787692438.137651:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+27:11522:x1874531108071040:12345-192.168.206.27@tcp:58:lfs.0 Request processed in 1152us (1500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692438.137665:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 169 00000100:00100000:1.0:1787692438.157219:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692438.157313:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108071168 00000100:00100000:0.0:1787692438.157327:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108071168 00000100:00100000:0.0:1787692438.157421:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 170 00000100:00100000:0.0:1787692438.157440:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+27:11524:x1874531108071168:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692438.157466:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692438.157491:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09deea1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24d5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.157573:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deea8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.157590:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.157603:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.157619:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deeaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.157627:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deeaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.157635:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deeaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.158556:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09deeb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.158571:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09deeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.158581:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09deeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692438.158642:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787692438.158861:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692438.158891:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09deeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.158905:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09deeb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.158914:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deea8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.158921:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deea8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.158928:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deea8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.158935:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692438.158940:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deea8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.158948:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deea8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.158963:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:0.0:1787692438.158967:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692438.158972:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deea8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.158979:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deea8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.159002:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deeaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.159006:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deeaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.159010:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deeaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.159013:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692438.159014:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deeaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.159018:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deeaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.159023:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec832f4600) 00010000:00010000:0.0:1787692438.159024:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692438.159026:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deeaf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.159030:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deeaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.159061:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09deea1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24d5 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.159070:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09deeb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24d5 expref: 28 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.159085:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636100) 00010000:00010000:0.0:1787692438.159086:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787692438.159088:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0600, rc 0) 00000100:00100000:0.0:1787692438.159230:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+28:11524:x1874531108071168:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1797us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692438.159239:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 170 00000040:00080000:2.0:1787692438.278256:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787692438.278270:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787692438.278330:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1787692438.278338:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787692438.278577:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecc5660380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874531125895168:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787692438.278795:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9144e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787692438.288714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692438.288841:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108071296 00000100:00100000:3.0:1787692438.288854:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108071296 00000100:00100000:3.0:1787692438.288938:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 171 00000100:00100000:3.0:1787692438.288951:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+29:11535:x1874531108071296:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787692438.288992:0:8461:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787692438.289126:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+29:11535:x1874531108071296:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 177us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692438.289135:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 171 00000100:00100000:0.0:1787692438.289795:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecc5660380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874531125895168:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787692438.292670:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692438.303955:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108071424 00000100:00100000:2.0:1787692438.303977:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108071424 00000100:00100000:2.0:1787692438.304149:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 172 00000100:00100000:2.0:1787692438.304162:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+28:11535:x1874531108071424:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787692438.304263:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09deebd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.305250:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09deebd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.305268:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09deebd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.305377:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deec4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.305385:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deec4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.305392:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deec4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.305425:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09deecb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.305432:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09deecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.305438:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09deecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692438.307472:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787692438.307950:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787692438.307978:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09deecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308007:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09deebd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308099:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09deebd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308107:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09deebd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308115:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692438.308121:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09deebd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308131:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09deebd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308154:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec832f4e00) 00010000:00010000:3.0:1787692438.308158:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692438.308163:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09deebd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308169:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09deebd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308187:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deec4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308194:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deec4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308200:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deec4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308206:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692438.308217:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deec4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308223:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deec4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308233:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff92ec94636700) 00010000:00010000:3.0:1787692438.308236:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692438.308239:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deec4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308246:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09deec4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308271:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09deecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308278:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09deecb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308284:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09deecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308289:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692438.308292:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09deecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308298:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09deecb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308321:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636100) 00010000:00010000:3.0:1787692438.308324:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692438.308333:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09deecb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.308340:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09deecb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692438.308466:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+28:11535:x1874531108071424:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 Request processed in 4300us (15803us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692438.308551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 172 00000100:00100000:3.0:1787692438.312122:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692438.312608:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108071680 00000100:00100000:0.0:1787692438.312622:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108071680 00000100:00100000:0.0:1787692438.312699:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 173 00000100:00100000:0.0:1787692438.312712:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+28:11535:x1874531108071680:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787692438.312740:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692438.312767:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deed2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24dc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.313222:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.313242:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.313255:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692438.313268:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787692438.314452:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.314478:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deed9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.314667:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.314676:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692438.314681:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.314690:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deed9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.314710:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636100) 00010000:00010000:0.0:1787692438.314713:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787692438.314719:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deed9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.314725:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09deed9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.314790:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deed2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24dc expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.314802:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec832f4e00) 00010000:00010000:0.0:1787692438.314805:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787692438.314809:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deed2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24dc expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.315994:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1600, rc 0) 00000100:00100000:3.0:1787692438.317030:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+29:11535:x1874531108071680:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 4307us (4911us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787692438.317045:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 173 00000100:00100000:2.0:1787692438.321877:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692438.322672:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108071808 00000100:00100000:1.0:1787692438.322689:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108071808 00000100:00100000:1.0:1787692438.322777:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 174 00000100:00100000:1.0:1787692438.322789:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+29:11535:x1874531108071808:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787692438.322855:0:8193:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787692438.323011:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+29:11535:x1874531108071808:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 223us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692438.323021:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 174 00000100:00100000:3.0:1787692438.327428:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692438.327699:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108072064 00000100:00100000:1.0:1787692438.327711:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108072064 00000100:00100000:1.0:1787692438.327786:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 175 00000100:00100000:1.0:1787692438.327798:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+29:11535:x1874531108072064:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787692438.327847:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692438.327852:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787692438.327897:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09dee93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ce expref: 29 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.327918:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:1.0:1787692438.327924:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787692438.327939:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09deee7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24e3 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787692438.330681:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1787692438.331342:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09deeee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.331363:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09deeee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.331377:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09deeee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.331667:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09deee7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24e3 expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.331688:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09deeee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24e3 expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.331699:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ec9dbfa100) 00010000:00010000:1.0:1787692438.331702:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787692438.331706:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165800, rc 0) 00000100:00100000:1.0:1787692438.331808:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+30:11535:x1874531108072064:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 4011us (4392us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1787692438.331854:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 175 00000100:00100000:3.0:1787692438.340915:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692438.341150:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108072320 00000100:00100000:0.0:1787692438.341175:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108072320 00000100:00100000:0.0:1787692438.341256:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 176 00000100:00100000:0.0:1787692438.341268:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+30:11535:x1874531108072320:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787692438.341354:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692438.341389:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09deeee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24e3 expref: 30 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341413:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ec9dbfa100) 00010000:00010000:0.0:1787692438.341427:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787692438.341457:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deefc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341473:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deefc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341483:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deefc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341499:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09def03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc4962dca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341507:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09def03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4962dca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341513:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09def03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4962dca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341901:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deefc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341922:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deefc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341929:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deefc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341935:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692438.341941:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deefc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341950:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deefc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341960:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:0.0:1787692438.341964:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692438.341968:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deefc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341974:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09deefc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341984:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09def03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4962dca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341991:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09def03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4962dca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.341997:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09def03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4962dca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.342003:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692438.342014:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09def03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4962dca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.342021:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09def03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc4962dca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.342028:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc4962dca (ffff92ec832f4600) 00010000:00010000:0.0:1787692438.342031:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692438.342034:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09def03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc4962dca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.342039:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09def03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc4962dca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692438.342147:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+29:11535:x1874531108072320:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 880us (1245us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787692438.342156:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 176 00000100:00100000:2.0:1787692438.348625:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692438.348751:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108072448 00000100:00100000:1.0:1787692438.348765:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108072448 00000100:00100000:1.0:1787692438.348861:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 177 00000100:00100000:1.0:1787692438.348886:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+29:11535:x1874531108072448:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787692438.348914:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692438.348954:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09def0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24ea expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.349000:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.349015:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.349028:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.349224:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09def0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ea expref: 31 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.349245:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ea expref: 30 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.349255:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ec9dbfa200) 00010000:00010000:1.0:1787692438.349259:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787692438.349263:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165a00, rc 0) 00000100:00100000:1.0:1787692438.349354:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+30:11535:x1874531108072448:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 482us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692438.349363:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 177 00000100:00100000:0.0:1787692438.358039:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692438.358110:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108072704 00000100:00100000:1.0:1787692438.358124:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108072704 00000100:00100000:1.0:1787692438.358262:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 178 00000100:00100000:1.0:1787692438.358275:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+30:11535:x1874531108072704:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787692438.358483:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09def18 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.358511:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09def18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.358524:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09def18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787692438.358987:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1787692438.359000:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344565186787ns, next at 345565183575ns, rc = 0 00000004:00010000:0.0:1787692438.359216:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096421a18 reply state 00000000e22c20b2 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09def18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692438.359229:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787692438.359360:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf914380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+32:11535:x1874531108072704:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 1086us (1346us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787692438.359369:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 178 00010000:00010000:3.0:1787692438.369235:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09def18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.369253:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09def18 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.369261:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09def18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.369267:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692438.369284:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09def18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.369293:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09def18 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.369335:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ec9dbfa200) 00010000:00010000:3.0:1787692438.369338:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787692438.369344:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09def18 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.369351:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09def18 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692438.373142:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692438.373610:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108072832 00000100:00100000:1.0:1787692438.373624:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108072832 00000100:00100000:1.0:1787692438.373696:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 179 00000100:00100000:1.0:1787692438.373708:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+31:11535:x1874531108072832:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787692438.373741:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692438.373767:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09def1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24f1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.373877:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09def1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24f1 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.373895:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09def1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24f1 expref: 32 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.373919:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ec9dbfa200) 00010000:00010000:1.0:1787692438.373923:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787692438.373927:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164a00, rc 0) 00000100:00100000:1.0:1787692438.374002:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+32:11535:x1874531108072832:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 295us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692438.374022:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 179 00000100:00100000:2.0:1787692438.377614:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692438.377912:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108072960 00000100:00100000:3.0:1787692438.377925:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108072960 00000100:00080000:1.0:1787692438.378090:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787692438.378104:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:3.0:1787692438.378122:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2362:x1874531108072960:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787692438.378599:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5661f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+7:2362:x1874531108072960:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 481us (998us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1787692438.378608:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:0.0:1787692438.381941:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692438.381997:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108073216 00000100:00100000:3.0:1787692438.382010:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108073216 00000100:00100000:3.0:1787692438.382081:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:3.0:1787692438.382096:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+32:11535:x1874531108073216:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787692438.382415:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+33:11535:x1874531108073216:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 322us (487us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787692438.382424:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:3.0:1787692438.385197:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692438.385270:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108073472 00000100:00100000:0.0:1787692438.385293:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108073472 00000100:00100000:0.0:1787692438.385381:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 180 00000100:00100000:0.0:1787692438.385392:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+33:11535:x1874531108073472:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787692438.385558:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+33:11535:x1874531108073472:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 167us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692438.385567:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 180 00000100:00100000:2.0:1787692438.388052:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692438.388211:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108073600 00000100:00100000:0.0:1787692438.388223:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108073600 00000100:00100000:0.0:1787692438.388293:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 181 00000100:00100000:0.0:1787692438.388313:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+33:11535:x1874531108073600:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787692438.388335:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692438.388361:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09def26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24f8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.388442:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09def2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.388458:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09def2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.388470:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09def2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692438.388513:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692438.388533:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09def2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.388561:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1600/0x5d8b8560a09def26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24f8 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.388577:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09def2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24f8 expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.388609:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ec9dbfa200) 00010000:00010000:0.0:1787692438.388613:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787692438.388618:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1a00, rc 0) 00000100:00100000:0.0:1787692438.388684:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+34:11535:x1874531108073600:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 383us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692438.388692:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 181 00000100:00100000:0.0:1787692438.392357:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692438.392515:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108073728 00000100:00100000:2.0:1787692438.392527:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108073728 00000100:00100000:2.0:1787692438.392597:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:2.0:1787692438.392609:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2363:x1874531108073728:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692438.392631:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692438.392658:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d85c5a83/0x5d8b8560a09def34 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b24ff expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787692438.392716:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8e0596, blocks: 0x1 00010000:00010000:2.0:1787692438.392742:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1787692438.392747:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692438.392759:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d85c5a83/0x5d8b8560a09def34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ff expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.392781:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d85c5a83/0x5d8b8560a09def34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ff expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.392798:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2a00, rc 0) 00000100:00100000:2.0:1787692438.393168:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf916a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+8:2363:x1874531108073728:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 550us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692438.393177:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:2.0:1787692438.401739:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692438.402114:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108073984 00000100:00100000:3.0:1787692438.402127:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108073984 00000100:00100000:3.0:1787692438.402218:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 182 00000100:00100000:3.0:1787692438.402230:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+34:11535:x1874531108073984:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787692438.402393:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+34:11535:x1874531108073984:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 165us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692438.402402:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 182 00000100:00100000:2.0:1787692438.408699:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692438.409138:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108074112 00000100:00100000:0.0:1787692438.409152:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108074112 00000100:00100000:0.0:1787692438.409221:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:0.0:1787692438.409231:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+8:11535:x1874531108074112:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787692438.409254:0:8080:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692438.409286:0:8080:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09def3b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2506 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.409335:0:8080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d85c5a83/0x5d8b8560a09def34 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ff expref: 9 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.409345:0:8080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692438.409350:0:8080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692438.409355:0:8080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09def3b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2506 expref: 9 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.409393:0:8080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d85c5a83/0x5d8b8560a09def34 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ff expref: 9 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.409426:0:8080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d85c5a83/0x5d8b8560a09def34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ff expref: 9 pid: 6680 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692438.409443:0:8080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf916d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8080:1874531125895296:192.168.206.27@tcp:104: 00000100:00100000:0.0:1787692438.410137:0:8080:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90326d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787692438.414445:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692438.414985:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108074240 00000100:00100000:3.0:1787692438.414999:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108074240 00010000:00010000:3.0:1787692438.415057:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d85c5a83/0x5d8b8560a09def34 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ff expref: 10 pid: 6680 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692438.415107:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:3.0:1787692438.415119:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+10:2361:x1874531108074240:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692438.415139:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692438.415169:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d85c5a83/0x5d8b8560a09def34 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ff expref: 10 pid: 6680 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.415187:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d85c5a83/0x5d8b8560a09def34 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ff expref: 10 pid: 6680 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.415219:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692438.415225:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692438.415235:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09def3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2506 expref: 10 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.415248:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09def3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2506 expref: 10 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.415342:0:8440:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09def3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2506 expref: 10 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692438.415360:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8440:1874531125895424:192.168.206.27@tcp:105: 00000100:00100000:3.0:1787692438.415481:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9dac6a80 going to sleep for 11 seconds 00010000:00010000:2.0:1787692438.417015:0:8080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d85c5a83/0x5d8b8560a09def34 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ff expref: 10 pid: 6680 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692438.417041:0:8080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf916d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8080:1874531125895296:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692438.417076:0:8080:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09def3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2506 expref: 9 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.417092:0:8080:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1600, rc 0) 00000100:00100000:2.0:1787692438.417210:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5663800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+9:11535:x1874531108074112:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 7979us (8523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692438.417237:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:3.0:1787692438.423598:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8440:1874531125895424:192.168.206.27@tcp:105: 00010000:00010000:3.0:1787692438.423639:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692438.423714:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+8:2361:x1874531108074240:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 8597us (9283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692438.423727:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:2.0:1787692438.426244:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692438.426416:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108074368 00000100:00100000:1.0:1787692438.426428:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108074368 00002000:00100000:1.0:1787692438.426492:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff92ecc5660380 x1874531108074368/t0(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:429/0 lens 504/0 e 0 to 0 dl 1787692449 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787692438.426506:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecc5660380 with x1874531108074368 ext(0->8) 00002000:00010000:1.0:1787692438.426512:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecc5660380 00000100:00100000:1.0:1787692438.426551:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:1.0:1787692438.426562:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:067f46f5-4779-40e6-b53d-5b3e89751501+8:2362:x1874531108074368:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787692438.427179:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:067f46f5-4779-40e6-b53d-5b3e89751501+10:2362:x1874531108074368:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 Request processed in 616us (945us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787692438.427189:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00002000:00100000:1.0:1787692438.427197:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff92ecc5660380 x1874531108074368/t4294967314(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:429/0 lens 504/448 e 0 to 0 dl 1787692449 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787692438.427206:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecc5660380 with x1874531108074368 ext(0->8) 00002000:00010000:1.0:1787692438.427210:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecc5660380 00000100:00100000:1.0:1787692438.429806:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692438.430556:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108074496 00000100:00100000:0.0:1787692438.430571:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108074496 00000100:00100000:0.0:1787692438.430714:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 183 00000100:00100000:0.0:1787692438.430728:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+34:11535:x1874531108074496:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787692438.486655:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000020:00080000:3.0:1787692438.486686:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1787692438.486709:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1787692438.486714:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:3.0:1787692438.486754:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:3.0:1787692438.486969:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125895552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787692438.487063:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692438.487163:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125895552 00000100:00100000:3.0:1787692438.487172:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125895552 00000100:00100000:3.0:1787692438.487254:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787692438.487264:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125895552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787692438.487500:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787692438.487504:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787692438 00002000:00010000:3.0:1787692438.487506:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787692438.487508:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787692438 -> 1787692438 00002000:00010000:3.0:1787692438.487543:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787692438.487596:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874531125895552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 333us (534us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787692438.487605:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1787692438.487654:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92ecaf67bb80/2, rc 0, transno 4294967315 00000100:00100000:3.0:1787692438.487661:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125895552:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1787692438.488085:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787692438.488101:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787692438.488477:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+18:11535:x1874531108074496:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 Request processed in 57747us (58682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692438.488489:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 183 00000100:00080000:1.0:1787692438.490499:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787692438.497575:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692438.498387:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108074624 00000100:00100000:3.0:1787692438.498415:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108074624 00000100:00100000:3.0:1787692438.498493:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:3.0:1787692438.498506:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+10:2364:x1874531108074624:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787692438.556331:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+10:2364:x1874531108074624:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 Request processed in 57812us (58756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692438.556349:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 55 00000001:00080000:3.0:1787692438.556396:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:3.0:1787692438.556414:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1787692438.566441:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692438.568679:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108074880 00000100:00100000:3.0:1787692438.568698:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108074880 00000100:00100000:3.0:1787692438.569385:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 184 00000100:00100000:3.0:1787692438.569402:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+18:11535:x1874531108074880:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787692438.569474:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692438.569508:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09def2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24f8 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.569534:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ec9dbfa200) 00010000:00010000:3.0:1787692438.569541:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787692438.569581:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.569611:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.569623:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787692438.569976:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f92c904b reply state 00000000aa658f27 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692438.569987:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787692438.570133:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+19:11535:x1874531108074880:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 736us (3715us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787692438.570141:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 184 00010000:00010000:2.0:1787692438.575682:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.575706:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.575716:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.575724:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692438.575730:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.575740:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.575764:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ec9dbfa200) 00010000:00010000:2.0:1787692438.575768:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692438.575774:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.575781:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692438.576201:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692438.576445:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108075008 00000100:00100000:3.0:1787692438.576457:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108075008 00000100:00100000:3.0:1787692438.576526:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:3.0:1787692438.576538:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2363:x1874531108075008:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787692438.576885:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787692438.576890:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787692438 -> 1787692437 00002000:00010000:3.0:1787692438.576893:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787692436 00002000:00010000:3.0:1787692438.576896:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787692438 -> 1787692437 00002000:00010000:3.0:1787692438.576898:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787692438.576965:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+8:2363:x1874531108075008:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 428us (770us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787692438.576973:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:1.0:1787692438.608987:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692438.609143:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108075264 00000100:00100000:3.0:1787692438.609157:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108075264 00000100:00100000:3.0:1787692438.609611:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 185 00000100:00100000:3.0:1787692438.609631:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+18:11535:x1874531108075264:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787692438.609724:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.609743:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def11 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ea expref: 18 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.609753:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.609799:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ea expref: 18 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.609853:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ea expref: 18 pid: 8193 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692438.609871:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf937b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125895680:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692438.609983:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec87d9e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787692438.612687:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf937b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125895680:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692438.612728:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692438.617423:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692438.617984:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108075392 00000100:00100000:0.0:1787692438.617997:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108075392 00010000:00010000:0.0:1787692438.618121:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ea expref: 19 pid: 8193 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692438.618355:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 71 00000100:00100000:0.0:1787692438.618367:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf937b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+19:2362:x1874531108075392:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692438.618411:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692438.618421:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def11 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ea expref: 19 pid: 8193 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.618437:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ea expref: 19 pid: 8193 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.618465:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24ea expref: 19 pid: 8193 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.618485:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ec9dbfa200) 00010000:00010000:0.0:1787692438.618491:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.618501:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.618510:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.618544:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692438.618614:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf937b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+18:2362:x1874531108075392:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 249us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692438.618622:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 71 00010000:00010000:0.0:1787692438.621295:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.621327:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.621378:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.621385:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.621392:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.621398:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692438.621402:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.621410:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.621431:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ec9dbfa200) 00010000:00010000:0.0:1787692438.621434:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787692438.621440:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.621446:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692438.621573:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+17:11535:x1874531108075264:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 Request processed in 11943us (12596us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787692438.622444:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 185 00000100:00100000:0.0:1787692438.638441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692438.638838:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108075520 00000100:00100000:3.0:1787692438.638851:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108075520 00000100:00100000:3.0:1787692438.638930:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:3.0:1787692438.638944:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+8:2361:x1874531108075520:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787692438.639002:0:8080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.639042:0:8080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09def3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2506 expref: 8 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.639064:0:8080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692438.639069:0:8080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787692438.639074:0:8080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.639120:0:8080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09def3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2506 expref: 8 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.639137:0:8080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09def3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2506 expref: 8 pid: 8080 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692438.639155:0:8080:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8080:1874531125895808:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692438.639258:0:8080:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec87d9e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787692438.648894:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692438.648933:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108075648 00000100:00100000:0.0:1787692438.648957:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108075648 00010000:00010000:0.0:1787692438.649008:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09def3b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2506 expref: 9 pid: 8080 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692438.649054:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 72 00000100:00100000:0.0:1787692438.649066:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf915880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+9:2362:x1874531108075648:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692438.649084:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692438.649115:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09def3b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2506 expref: 9 pid: 8080 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.649131:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09def3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2506 expref: 9 pid: 8080 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.649163:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787692438.649169:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787692438.649176:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.649187:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.649213:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692438.649287:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf915880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+9:2362:x1874531108075648:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 223us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692438.649296:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 72 00010000:00010000:0.0:1787692438.649438:0:8080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09def3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2506 expref: 8 pid: 8080 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692438.649468:0:8080:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8080:1874531125895808:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692438.649499:0:8080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.649510:0:8080:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.649517:0:8080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.649546:0:8080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.649555:0:8080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.649563:0:8080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.649570:0:8080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692438.649575:0:8080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.649584:0:8080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.649605:0:8080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.649612:0:8080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007486033e/0x5d8b8560a09def50 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692438.649677:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf917100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108075520:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 Request processed in 10736us (11249us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692438.649686:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:3.0:1787692438.663955:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692438.664313:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108075904 00000100:00100000:1.0:1787692438.664326:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108075904 00000100:00100000:1.0:1787692438.664407:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 186 00000100:00100000:1.0:1787692438.664420:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+17:11535:x1874531108075904:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787692438.664545:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09def57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.664566:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09def57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.664582:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09def57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.664904:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.664917:0:8193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09def1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24f1 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.664925:0:8193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.664969:0:8193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09def1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24f1 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692438.664985:0:8193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09def1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24f1 expref: 18 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692438.665002:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125895936:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692438.665108:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692438.671490:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125895936:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692438.671540:0:8193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692438.674156:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692438.676438:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108076032 00000100:00100000:0.0:1787692438.676466:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108076032 00010000:00010000:0.0:1787692438.676527:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09def1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24f1 expref: 19 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692438.676571:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 73 00000100:00100000:0.0:1787692438.676583:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+19:2362:x1874531108076032:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692438.676600:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692438.676609:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09def1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24f1 expref: 19 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.676624:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09def1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24f1 expref: 19 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.676649:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09def1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24f1 expref: 19 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.676694:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ec9dbfa200) 00010000:00010000:0.0:1787692438.676699:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.676709:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.676718:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.676752:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692438.676853:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+18:2362:x1874531108076032:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 271us (2712us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692438.676861:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 73 00010000:00010000:0.0:1787692438.677023:0:8193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692438.677032:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787692438.677268:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1787692438.680767:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787692438.683613:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1787692438.683779:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf915500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8193:1874531125896064:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787692438.683881:0:8193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692438.683922:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9dac6600 going to sleep for 11 seconds 00000100:00100000:3.0:1787692438.685038:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125896064 00000100:00100000:3.0:1787692438.685053:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125896064 00000100:00100000:3.0:1787692438.685132:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787692438.685148:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8193:x1874531125896064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787692438.685275:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf916d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8193:x1874531125896064:12345-0@lo:1000:mdt00_003.0 Request processed in 130us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692438.685284:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787692438.685348:0:8193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787692438.685355:0:8193:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92ecaf67bb80, transno 4294967315 00000100:00100000:3.0:1787692438.685369:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf915500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8193:1874531125896064:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787692438.686126:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787692438.686216:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf71df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8193:1874531125896192:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787692438.686268:0:8193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692438.686296:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca89576c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692438.686543:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125896192 00000100:00100000:3.0:1787692438.686549:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125896192 00000100:00100000:3.0:1787692438.688265:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787692438.688298:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8193:x1874531125896192:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787692438.692719:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8193:x1874531125896192:12345-0@lo:1000:mdt00_003.0 Request processed in 4419us (6437us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787692438.692738:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787692438.693918:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf71df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8193:1874531125896192:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787692438.693977:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.693989:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.693999:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.694005:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692438.694010:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.694019:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.694037:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ec9dbfa200) 00010000:00010000:2.0:1787692438.694041:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787692438.694046:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.694053:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09def5e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.694095:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.694103:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.694109:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.694360:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692438.694364:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.694371:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.694382:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636100) 00010000:00010000:2.0:1787692438.694385:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787692438.694388:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.694395:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09dee9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.694492:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.694510:0:8193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09deeb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24d5 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.694519:0:8193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.694577:0:8193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09deeb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24d5 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.694596:0:8193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09deeb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24d5 expref: 21 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692438.694612:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf67bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125896320:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692438.694718:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca8957180 going to sleep for 11 seconds 00000100:00100000:1.0:1787692438.738753:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692438.738855:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108076160 00000100:00100000:2.0:1787692438.738867:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108076160 00010000:00010000:2.0:1787692438.738928:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09deeb6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24d5 expref: 22 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692438.738970:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:2.0:1787692438.738982:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+22:2361:x1874531108076160:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692438.738999:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692438.739008:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09deeb6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24d5 expref: 22 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.739024:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09deeb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24d5 expref: 22 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.739073:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636100) 00010000:00010000:2.0:1787692438.739078:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.739091:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.739099:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.739123:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692438.739192:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+22:2361:x1874531108076160:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 211us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692438.739199:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 74 00010000:00010000:3.0:1787692438.739656:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09deeb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b24d5 expref: 21 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692438.739678:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf67bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125896320:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692438.739709:0:8193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739720:0:8193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739727:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739742:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739749:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739757:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739763:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692438.739768:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739777:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739788:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636100) 00010000:00010000:3.0:1787692438.739791:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692438.739807:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739841:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def65 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739856:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09def57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739863:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09def57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739879:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09def57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739886:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692438.739889:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09def57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739896:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09def57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739905:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec94636100) 00010000:00010000:3.0:1787692438.739907:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787692438.739910:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09def57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.739917:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09def57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692438.740179:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+20:11535:x1874531108075904:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 75760us (76236us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787692438.740189:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 186 00000020:00080000:3.0:1787692438.740201:0:8193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787692438.740610:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787692438.740615:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787692438.741158:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787692438.741169:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787692438.746337:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692438.746652:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108076416 00000100:00100000:3.0:1787692438.746666:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108076416 00000100:00100000:3.0:1787692438.746742:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:3.0:1787692438.746755:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83551450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+20:11535:x1874531108076416:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787692438.749206:0:5835:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787692438.750796:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1787692438.750940:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.750962:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.750976:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.750986:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def6c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.750994:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def6c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.751001:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692438.751027:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787692438.751166:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83551450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+22:11535:x1874531108076416:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 4408us (4837us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1787692438.751178:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 50 00000020:00080000:3.0:1787692438.751186:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787692438.751667:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692438.751678:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.751687:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031e00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692438.751693:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.751702:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.751735:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff92ec9459aa00) 00010000:00010000:2.0:1787692438.751738:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787692438.751744:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def6c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.751749:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692438.751772:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692438.751774:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692438.751776:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692439.042737:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787692439.131518:0:12453:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787692439.131532:0:12453:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787692439.134223:0:12453:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1787692439.134236:0:12453:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787692439.258756:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692439.258919:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108076672 00000100:00100000:3.0:1787692439.258941:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108076672 00000100:00100000:3.0:1787692439.259073:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 187 00000100:00100000:3.0:1787692439.259086:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+22:11546:x1874531108076672:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1787692439.259113:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692439.259138:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09def73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b250d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.259603:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.259621:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.259634:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692439.259647:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787692439.259900:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09def73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b250d expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.259920:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b250d expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.259929:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:3.0:1787692439.259932:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787692439.259937:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec80031000, rc 0) 00000100:00100000:3.0:1787692439.260013:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf917b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+24:11546:x1874531108076672:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 929us (1268us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787692439.260021:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 187 00000100:00080000:1.0:1787692439.262734:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692439.265121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692439.269410:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108076800 00000100:00100000:3.0:1787692439.269435:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108076800 00000100:00100000:3.0:1787692439.269516:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 188 00000100:00100000:3.0:1787692439.269528:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+24:11546:x1874531108076800:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:3.0:1787692439.269631:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.269652:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.269665:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.269684:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09def8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.269692:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09def8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.269699:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09def8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.270661:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09def96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.270676:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09def96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.270687:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09def96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787692439.270741:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09def96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.270764:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.270770:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.270777:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.270783:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692439.270788:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.270796:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271594:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:3.0:1787692439.271601:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692439.271609:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271619:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09def88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271636:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09def8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271643:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09def8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271648:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09def8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271661:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692439.271665:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09def8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271672:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09def8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271684:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec9459af00) 00010000:00010000:3.0:1787692439.271686:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692439.271689:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09def8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271696:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09def8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271715:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09def96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271721:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09def96 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271727:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09def96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271732:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692439.271735:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09def96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271742:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09def96 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271761:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec9459a700) 00010000:00010000:3.0:1787692439.271763:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692439.271766:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09def96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.271773:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09def96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692439.272545:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+24:11546:x1874531108076800:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 3009us (7429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692439.272559:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 188 00000100:00100000:3.0:1787692439.346795:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692439.347140:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108077056 00000100:00100000:1.0:1787692439.347154:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108077056 00000100:00100000:1.0:1787692439.347233:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 189 00000100:00100000:1.0:1787692439.347245:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+24:11549:x1874531108077056:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692439.347272:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692439.347311:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09def9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2514 expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.347699:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09defa4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.347720:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09defa4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.347734:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09defa4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.348459:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09defab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.348469:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09defab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.348501:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09defab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349023:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09defb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349032:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09defb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349041:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09defb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692439.349054:0:8193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787692439.349175:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09defa4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349183:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09defa4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349189:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09defa4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349196:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692439.349200:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09defa4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349209:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09defa4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349223:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:1.0:1787692439.349227:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692439.349239:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09defa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349246:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165e00/0x5d8b8560a09defa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349258:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09defab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349264:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09defab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349269:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09defab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349274:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692439.349277:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09defab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349283:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09defab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349290:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec9dbfae00) 00010000:00010000:1.0:1787692439.349292:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692439.349295:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09defab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349312:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09defab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349429:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09def9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2514 expref: 27 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349460:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09defb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2514 expref: 26 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.349468:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec9dbfa800) 00010000:00010000:1.0:1787692439.349471:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787692439.349473:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165000, rc 0) 00000100:00100000:1.0:1787692439.349728:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+26:11549:x1874531108077056:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 2482us (2945us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1787692439.349738:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 189 00000100:00100000:1.0:1787692439.352781:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692439.353677:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108077184 00000100:00100000:3.0:1787692439.353690:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108077184 00000100:00100000:3.0:1787692439.353768:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 190 00000100:00100000:3.0:1787692439.353781:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+26:11549:x1874531108077184:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:3.0:1787692439.353893:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09defc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.353912:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09defc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.353925:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09defc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.353957:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09defc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.353964:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09defc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.353991:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09defc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.353997:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692439.354002:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09defc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.354011:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09defc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.354025:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec9dbfa800) 00010000:00010000:3.0:1787692439.354029:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787692439.354034:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09defc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.354041:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09defc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692439.354131:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+26:11549:x1874531108077184:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 352us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692439.354140:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 190 00000100:00100000:3.0:1787692439.357025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692439.357156:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108077440 00000100:00100000:2.0:1787692439.357168:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108077440 00000100:00100000:2.0:1787692439.357230:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:2.0:1787692439.357240:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+26:11549:x1874531108077440:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1787692439.358109:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+27:11549:x1874531108077440:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 864us (1089us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787692439.358120:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:2.0:1787692439.385877:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692439.386035:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108077696 00000100:00100000:3.0:1787692439.386049:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108077696 00000100:00100000:3.0:1787692439.386244:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 191 00000100:00100000:3.0:1787692439.386257:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+27:11083:x1874531108077696:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:3.0:1787692439.386293:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692439.386327:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09defc7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b251b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.386538:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.386555:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09defb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2514 expref: 28 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.386565:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.386609:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09defb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2514 expref: 28 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.386624:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09defb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2514 expref: 28 pid: 8193 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692439.386639:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecc5661180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125896448:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692439.386833:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90213840 going to sleep for 11 seconds 00000100:00100000:1.0:1787692439.389335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692439.389585:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108077824 00000100:00100000:0.0:1787692439.389598:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108077824 00010000:00010000:0.0:1787692439.389663:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09defb2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2514 expref: 29 pid: 8193 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692439.389747:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:0.0:1787692439.389757:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+29:2362:x1874531108077824:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692439.389771:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692439.389779:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09defb2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2514 expref: 29 pid: 8193 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.389791:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09defb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2514 expref: 29 pid: 8193 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692439.389855:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecc5661180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125896448:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692439.389856:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09defb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2514 expref: 29 pid: 8193 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.389886:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec9dbfa800) 00010000:00010000:0.0:1787692439.389892:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.389904:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.389912:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.389925:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.389932:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787692439.389939:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.389947:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692439.389970:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:0.0:1787692439.389994:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+28:2362:x1874531108077824:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 237us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692439.390003:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 75 00010000:00010000:3.0:1787692439.390187:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09defc7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b251b expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.390206:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b251b expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.390214:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec9dbfa800) 00010000:00010000:3.0:1787692439.390217:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787692439.390219:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35ae00, rc 0) 00000100:00100000:3.0:1787692439.390256:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+28:11083:x1874531108077696:12345-192.168.206.27@tcp:101:bash.0 Request processed in 4002us (4391us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787692439.390265:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 191 00000100:00100000:1.0:1787692439.397693:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692439.397757:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108078080 00000100:00100000:3.0:1787692439.397770:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108078080 00000100:00100000:3.0:1787692439.397859:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 192 00000100:00100000:3.0:1787692439.397938:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+28:11083:x1874531108078080:12345-192.168.206.27@tcp:36:bash.0 00010000:00010000:2.0:1787692439.398383:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09defdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.398407:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09defdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.398922:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09defdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787692439.399031:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1787692439.399064:0:8193:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010f8405b reply state 000000008ffce7d9 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09defdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692439.399075:0:8193:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787692439.399132:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1787692439.399269:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+32:11083:x1874531108078080:12345-192.168.206.27@tcp:36:bash.0 Request processed in 1398us (1589us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1787692439.399278:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 192 00000020:00080000:2.0:1787692439.399286:0:8193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787692439.402085:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09defdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.402195:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09defdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.402204:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09defdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.402211:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692439.402218:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09defdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.402228:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09defdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.402263:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec9dbfa800) 00010000:00010000:3.0:1787692439.402267:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692439.402273:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09defdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.402280:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09defdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692439.403368:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692439.403661:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108078208 00000100:00100000:2.0:1787692439.403674:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108078208 00000100:00100000:2.0:1787692439.403797:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 193 00000100:00100000:2.0:1787692439.403903:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+31:11083:x1874531108078208:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1787692439.403934:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692439.403958:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09defe3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2522 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.404049:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09defe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2522 expref: 32 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.404065:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09defe3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2522 expref: 32 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.404089:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec9dbfa800) 00010000:00010000:2.0:1787692439.404092:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787692439.404096:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2400, rc 0) 00000100:00100000:2.0:1787692439.404273:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+32:11083:x1874531108078208:12345-192.168.206.27@tcp:101:bash.0 Request processed in 465us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692439.404281:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 193 00000100:00100000:2.0:1787692439.412296:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692439.412475:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108078336 00000100:00100000:3.0:1787692439.412488:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108078336 00000100:00100000:3.0:1787692439.412563:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00100000:3.0:1787692439.412576:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:11083:x1874531108078336:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:3.0:1787692439.412598:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692439.412627:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009649b70d/0x5d8b8560a09defea lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2529 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787692439.412660:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8e0595, atime: 0x6a8e0594, ctime: 0x6a8e0595, blocks: 0xb 00010000:00010000:3.0:1787692439.412690:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1787692439.412695:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692439.412705:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009649b70d/0x5d8b8560a09defea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2529 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.412723:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009649b70d/0x5d8b8560a09defea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2529 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.412738:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35b200, rc 0) 00000100:00100000:3.0:1787692439.412808:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+8:11083:x1874531108078336:12345-192.168.206.27@tcp:101:bash.0 Request processed in 236us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692439.412876:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00100000:3.0:1787692439.416584:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692439.418320:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108078464 00000100:00100000:2.0:1787692439.418342:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108078464 00002000:00010000:2.0:1787692439.418414:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787692439.418420:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecc5661180 with x1874531108078464 ext(0->18446744073709551615) 00002000:00010000:2.0:1787692439.418436:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecc5661180. 00000100:00100000:2.0:1787692439.418491:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:2.0:1787692439.418504:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:067f46f5-4779-40e6-b53d-5b3e89751501+8:2364:x1874531108078464:12345-192.168.206.27@tcp:10:bash.0 00002000:00010000:2.0:1787692439.418903:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787692439.418908:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787692437 -> 1787692439 00002000:00010000:2.0:1787692439.418910:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787692436 -> 1787692436 00002000:00010000:2.0:1787692439.418913:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787692437 -> 1787692439 00002000:00010000:2.0:1787692439.418916:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787692439.419077:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:067f46f5-4779-40e6-b53d-5b3e89751501+9:2364:x1874531108078464:12345-192.168.206.27@tcp:10:bash.0 Request processed in 575us (2508us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1787692439.419087:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00002000:00010000:2.0:1787692439.419091:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1787692439.419094:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecc5661180 with x1874531108078464 ext(0->18446744073709551615) 00002000:00010000:2.0:1787692439.419099:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecc5661180. 00000100:00100000:1.0:1787692439.550610:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692439.550660:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108078592 00000100:00100000:3.0:1787692439.550674:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108078592 00000100:00100000:3.0:1787692439.553586:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 194 00000100:00100000:3.0:1787692439.553625:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+32:11563:x1874531108078592:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:3.0:1787692439.554354:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deff1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.554377:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.554393:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.554415:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deff8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.554424:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.554431:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556617:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09defff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556643:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09defff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556657:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09defff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787692439.556805:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09defff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556840:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556848:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deff1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556856:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deff1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556862:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692439.556867:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deff1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556875:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deff1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556890:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:3.0:1787692439.556893:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692439.556899:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deff1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556905:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09deff1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556923:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556929:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deff8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556942:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556947:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692439.556951:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556958:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deff8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556967:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec9459ab00) 00010000:00010000:3.0:1787692439.556969:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692439.556973:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deff8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556979:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09deff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.556998:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09defff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.557005:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09defff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.557011:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09defff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.557016:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80030a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692439.557018:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09defff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.557038:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09defff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.557047:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec9dbfa800) 00010000:00010000:3.0:1787692439.557050:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787692439.557053:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09defff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.557059:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09defff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692439.557374:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+32:11563:x1874531108078592:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 3763us (6771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692439.557386:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 194 00000100:00100000:3.0:1787692439.611729:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692439.611922:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108078848 00000100:00100000:0.0:1787692439.611935:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108078848 00000100:00100000:0.0:1787692439.612093:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 195 00000100:00100000:0.0:1787692439.612106:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+32:11566:x1874531108078848:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692439.612133:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692439.612173:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df006 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2530 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.612264:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09df00d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.612280:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09df00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.612293:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09df00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.612330:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.612340:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.612347:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614116:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09df01b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614138:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09df01b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614165:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09df01b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692439.614181:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787692439.614330:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09df00d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614339:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09df00d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614346:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09df00d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614352:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692439.614358:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09df00d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614366:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09df00d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614381:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:0.0:1787692439.614385:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692439.614391:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09df00d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614398:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0200/0x5d8b8560a09df00d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614413:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614429:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614444:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614449:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692439.614453:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614459:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614469:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec832f4c00) 00010000:00010000:0.0:1787692439.614472:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692439.614475:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614481:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614551:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2530 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614586:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09df01b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2530 expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.614595:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec9dbfa800) 00010000:00010000:0.0:1787692439.614597:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787692439.614600:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0800, rc 0) 00000100:00100000:0.0:1787692439.615876:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+34:11566:x1874531108078848:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 3764us (4151us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1787692439.615907:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 195 00000100:00100000:0.0:1787692439.619729:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692439.619890:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108078976 00000100:00100000:2.0:1787692439.619902:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108078976 00000100:00100000:2.0:1787692439.619968:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 196 00000100:00100000:2.0:1787692439.619980:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+34:11566:x1874531108078976:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:2.0:1787692439.620094:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.620114:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b251b expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.620125:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.620171:0:8461:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b251b expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.620187:0:8461:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b251b expref: 34 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692439.620206:0:8461:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125896576:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692439.620336:0:8461:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca9000 going to sleep for 11 seconds 00000100:00100000:3.0:1787692439.624688:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692439.624884:0:8461:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8461:1874531125896576:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692439.624917:0:8461:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692439.625048:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108079232 00000100:00100000:0.0:1787692439.625057:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108079232 00000100:00100000:0.0:1787692439.625126:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:0.0:1787692439.625138:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+35:6060:x1874531108079232:12345-192.168.206.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787692439.625756:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+36:6060:x1874531108079232:12345-192.168.206.27@tcp:35:ldlm_bl.0 Request processed in 619us (1081us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1787692439.625764:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:3.0:1787692439.628744:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692439.628859:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108079360 00000100:00100000:2.0:1787692439.628870:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108079360 00010000:00010000:2.0:1787692439.629043:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b251b expref: 36 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692439.629092:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 76 00000100:00100000:2.0:1787692439.629102:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+36:2361:x1874531108079360:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692439.629135:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692439.629144:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b251b expref: 36 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.629158:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b251b expref: 36 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.629184:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09defce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b251b expref: 36 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.629203:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec9dbfa800) 00010000:00010000:2.0:1787692439.629209:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.629219:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.629227:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.629484:0:8461:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.629493:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.629599:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.629607:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.629614:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.629627:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:3.0:1787692439.629632:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.629639:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.629649:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec9dbfa800) 00010000:00010000:3.0:1787692439.629652:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787692439.629657:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.629663:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df029 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692439.629751:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf914000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+35:11566:x1874531108078976:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 9772us (10035us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692439.629761:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 196 00010000:00010000:2.0:1787692439.631861:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692439.632173:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+34:2361:x1874531108079360:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 3065us (3434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692439.632186:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 76 00000100:00100000:0.0:1787692439.634517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692439.634666:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108079616 00000100:00100000:1.0:1787692439.634678:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108079616 00000100:00100000:1.0:1787692439.634743:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:1.0:1787692439.634755:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+34:11566:x1874531108079616:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:1.0:1787692439.635085:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf916680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+35:11566:x1874531108079616:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 331us (588us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1787692439.635093:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:0.0:1787692439.733483:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692439.733636:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108079872 00000100:00100000:3.0:1787692439.733649:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108079872 00000100:00100000:3.0:1787692439.733729:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 197 00000100:00100000:3.0:1787692439.733743:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+35:11577:x1874531108079872:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:3.0:1787692439.733774:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692439.733800:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09df030 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2537 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.734069:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09df037 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.734106:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09df037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.734118:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09df037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.734134:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09df03e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.734141:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09df03e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692439.734146:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09df03e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735451:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735466:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735489:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692439.735501:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1787692439.735677:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09df037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735685:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09df037 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735692:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09df037 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735698:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692439.735703:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09df037 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735710:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09df037 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735724:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:2.0:1787692439.735726:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692439.735732:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09df037 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735739:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031e00/0x5d8b8560a09df037 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735756:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09df03e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735762:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09df03e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735775:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09df03e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735781:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec80031600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692439.735784:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09df03e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735791:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09df03e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735799:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec9459ab00) 00010000:00010000:2.0:1787692439.735802:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692439.735805:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09df03e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.735963:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031600/0x5d8b8560a09df03e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.736027:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80030a00/0x5d8b8560a09df030 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2537 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.736046:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2537 expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.736055:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec9dbfa800) 00010000:00010000:2.0:1787692439.736057:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692439.736060:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3600, rc 0) 00000100:00100000:2.0:1787692439.736151:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf915880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+37:11577:x1874531108079872:12345-192.168.206.27@tcp:101:cat.0 Request processed in 2411us (2680us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1787692439.736170:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 197 00000100:00100000:0.0:1787692439.742262:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692439.742594:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108080128 00000100:00100000:1.0:1787692439.742607:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108080128 00000100:00100000:1.0:1787692439.742730:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 54 00000100:00100000:1.0:1787692439.742743:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+37:11577:x1874531108080128:12345-192.168.206.27@tcp:35:cat.0 00000100:00100000:1.0:1787692439.743187:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+38:11577:x1874531108080128:12345-192.168.206.27@tcp:35:cat.0 Request processed in 446us (940us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787692439.743196:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 54 00000100:00100000:3.0:1787692439.767049:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692439.767198:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108080384 00000100:00100000:0.0:1787692439.767212:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108080384 00000100:00100000:0.0:1787692439.767312:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 198 00000100:00100000:0.0:1787692439.767326:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+38:11578:x1874531108080384:12345-192.168.206.27@tcp:36:rm.0 00010000:00010000:0.0:1787692439.767411:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787692439.767448:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2537 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.767476:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0800/0x5d8b8560a09df01b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2530 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.767489:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09defe3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2522 expref: 36 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.767535:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec9dbfa800) 00010000:00010000:0.0:1787692439.767547:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787692439.767573:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df053 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.767589:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.767599:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.767617:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df05a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.767625:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.767632:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768022:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df061 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768031:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df061 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768039:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df061 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787692439.768720:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787692439.768733:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345974919261ns, next at 346974916231ns, rc = 0 00010000:00010000:0.0:1787692439.768842:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09df068 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768853:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09df068 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768862:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09df068 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768869:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09df068 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768876:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09df068 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768883:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09df068 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768913:0:5833:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692439.768938:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df061 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768944:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df061 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768951:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df061 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768957:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692439.768962:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df061 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768970:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df061 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.768987:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:0.0:1787692439.768990:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787692439.768995:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df061 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.769001:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df061 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.769020:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.769026:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df053 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.769032:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.769038:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692439.769041:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.769047:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df053 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.769055:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:0.0:1787692439.769058:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692439.769061:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df053 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.769067:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df053 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787692439.769088:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b12e8570 reply state 00000000814379eb transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692439.769096:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787692439.769212:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+37:11578:x1874531108080384:12345-192.168.206.27@tcp:36:rm.0 Request processed in 1885us (2172us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787692439.769221:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 198 00010000:00010000:2.0:1787692439.770698:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692439.770713:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09df068 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.770723:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692439.770728:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09df068 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.770737:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09df068 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.770752:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff92ec832f4600) 00010000:00010000:2.0:1787692439.770755:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787692439.770760:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09df068 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.770766:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0600/0x5d8b8560a09df068 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.770787:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692439.770790:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692439.770792:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692439.776158:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df05a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.776181:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df05a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.776189:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df05a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.776235:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692439.776241:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df05a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.776249:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df05a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.776281:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec832f4c00) 00010000:00010000:2.0:1787692439.776285:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692439.776291:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df05a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.776307:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df05a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692439.850016:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692439.850190:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108080640 00000100:00100000:2.0:1787692439.850203:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108080640 00000100:00100000:2.0:1787692439.850285:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 199 00000100:00100000:2.0:1787692439.850309:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+36:11584:x1874531108080640:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1787692439.850351:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692439.850379:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df06f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b253e expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.850751:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df076 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.850770:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df076 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.850806:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df076 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.850860:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df07d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.850883:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df07d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.850890:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df07d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787692439.852748:0:8461:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787692439.853094:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.853110:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.853122:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.853168:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df076 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.853176:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df076 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.853182:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df076 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.853188:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692439.853206:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df076 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.853215:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df076 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.853228:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:2.0:1787692439.853231:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692439.853236:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df076 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.853241:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df076 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787692439.853257:0:8461:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbc70a77 reply state 00000000fd17a435 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df07d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692439.854323:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787692439.854386:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df06f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b253e expref: 39 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.854417:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b253e expref: 38 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.854425:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec94636000) 00010000:00010000:2.0:1787692439.854427:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692439.854431:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2a00, rc 0) 00000100:00100000:2.0:1787692439.854544:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+39:11584:x1874531108080640:12345-192.168.206.27@tcp:101:bash.0 Request processed in 4247us (4542us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787692439.854553:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 199 00010000:00010000:1.0:1787692439.857668:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df07d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.857691:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df07d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.857699:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df07d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.857706:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692439.857712:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df07d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.857720:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df07d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.857741:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec94636b00) 00010000:00010000:1.0:1787692439.857745:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692439.857749:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df07d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.857756:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df07d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692439.866288:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692439.867240:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108080768 00000100:00100000:1.0:1787692439.867255:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108080768 00000100:00100000:1.0:1787692439.867414:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:1.0:1787692439.867427:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2363:x1874531108080768:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1787692439.867467:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692439.867509:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056fa18ec/0x5d8b8560a09df092 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2545 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787692439.867542:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787692439.867567:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1787692439.867572:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692439.867583:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056fa18ec/0x5d8b8560a09df092 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2545 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.867605:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056fa18ec/0x5d8b8560a09df092 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2545 expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692439.867620:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164c00, rc 0) 00000100:00100000:1.0:1787692439.867699:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2363:x1874531108080768:12345-192.168.206.27@tcp:101:bash.0 Request processed in 275us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692439.867707:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:3.0:1787692439.871017:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692439.871144:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108080896 00000100:00100000:0.0:1787692439.871158:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108080896 00000100:00100000:0.0:1787692439.871228:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:0.0:1787692439.871244:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+6:11584:x1874531108080896:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1787692439.871273:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692439.871303:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b254c expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.871341:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056fa18ec/0x5d8b8560a09df092 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2545 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.871360:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692439.871365:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692439.871371:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.871414:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056fa18ec/0x5d8b8560a09df092 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2545 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.871452:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056fa18ec/0x5d8b8560a09df092 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2545 expref: 7 pid: 6681 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692439.871469:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf915f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874531125896704:192.168.206.27@tcp:104: 00000100:00100000:0.0:1787692439.871662:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9dac6540 going to sleep for 11 seconds 00000100:00080000:2.0:1787692439.874847:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787692439.875977:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692439.876125:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108081024 00000100:00100000:2.0:1787692439.876137:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108081024 00010000:00010000:2.0:1787692439.876185:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056fa18ec/0x5d8b8560a09df092 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2545 expref: 8 pid: 6681 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692439.876239:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 77 00000100:00100000:2.0:1787692439.876250:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+8:2361:x1874531108081024:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692439.876278:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692439.876316:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056fa18ec/0x5d8b8560a09df092 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2545 expref: 8 pid: 6681 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.876331:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056fa18ec/0x5d8b8560a09df092 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2545 expref: 8 pid: 6681 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.876373:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692439.876378:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692439.876387:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.876407:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692439.876453:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692439.876470:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1874531125896832:192.168.206.27@tcp:105: 00000100:00100000:2.0:1787692439.876843:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca96c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787692439.878713:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056fa18ec/0x5d8b8560a09df092 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2545 expref: 8 pid: 6681 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692439.878741:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf915f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6680:1874531125896704:192.168.206.27@tcp:104: 00010000:00010000:0.0:1787692439.878776:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692439.878793:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0c00, rc 0) 00000100:00100000:0.0:1787692439.880125:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:11584:x1874531108080896:12345-192.168.206.27@tcp:101:bash.0 Request processed in 8878us (9112us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692439.880138:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:2.0:1787692439.889525:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1874531125896832:192.168.206.27@tcp:105: 00010000:00010000:2.0:1787692439.889563:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692439.889641:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108081024:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 13390us (13672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692439.889654:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 77 00000100:00100000:3.0:1787692439.894256:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692439.894875:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108081280 00000100:00100000:2.0:1787692439.894888:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108081280 00000100:00100000:2.0:1787692439.894967:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 55 00000100:00100000:2.0:1787692439.894980:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+38:11584:x1874531108081280:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:2.0:1787692439.895459:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+39:11584:x1874531108081280:12345-192.168.206.27@tcp:35:bash.0 Request processed in 480us (1217us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787692439.895469:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 55 00010000:00010000:1.0:1787692440.065170:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692440.095584:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.096206:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108081408 00000100:00100000:2.0:1787692440.096222:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108081408 00000100:00100000:2.0:1787692440.096315:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 200 00000100:00100000:2.0:1787692440.096329:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+39:11600:x1874531108081408:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692440.096380:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692440.096405:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df0a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2553 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.096608:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df0a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.096627:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.096675:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692440.096753:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787692440.096757:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692440.096785:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df0a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.096851:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df0a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2553 expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.096876:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df0a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2553 expref: 40 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.096886:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:2.0:1787692440.096889:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787692440.096893:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2400, rc 0) 00000100:00100000:2.0:1787692440.097002:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+40:11600:x1874531108081408:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 676us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692440.097010:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 200 00000100:00100000:3.0:1787692440.102572:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.102893:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108081664 00000100:00100000:1.0:1787692440.102906:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108081664 00000100:00100000:1.0:1787692440.102985:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 201 00000100:00100000:1.0:1787692440.102997:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+40:11600:x1874531108081664:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692440.103024:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692440.103049:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b255a expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.103194:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.103210:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.103224:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692440.103237:0:8193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787692440.104718:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b255a expref: 43 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.104749:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b255a expref: 42 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.104761:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec94636000) 00010000:00010000:1.0:1787692440.104764:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787692440.104768:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165400, rc 0) 00000100:00100000:1.0:1787692440.105697:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+42:11600:x1874531108081664:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 2694us (3356us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787692440.105710:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 201 00000100:00100000:3.0:1787692440.114065:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692440.114124:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.114252:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108082048 00000100:00100000:1.0:1787692440.114272:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108082048 00000100:00100000:1.0:1787692440.114371:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:1.0:1787692440.114384:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+42:2362:x1874531108082048:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787692440.114402:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692440.114552:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b255a expref: 42 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.114573:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec94636000) 00010000:00010000:1.0:1787692440.114579:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692440.114647:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+41:2362:x1874531108082048:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 266us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692440.114655:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:2.0:1787692440.114909:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108081920 00000100:00100000:2.0:1787692440.114914:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108081920 00000100:00100000:2.0:1787692440.114960:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 202 00000100:00100000:2.0:1787692440.114969:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+41:11600:x1874531108081920:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692440.114990:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692440.115009:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df0c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2561 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.115134:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df0ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.115149:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df0ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.115160:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df0ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692440.115172:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787692440.115343:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df0c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2561 expref: 44 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.116625:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df0ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2561 expref: 43 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.116637:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec94636000) 00010000:00010000:2.0:1787692440.116640:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787692440.116644:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3200, rc 0) 00000100:00100000:2.0:1787692440.116760:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+43:11600:x1874531108081920:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1792us (2710us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787692440.116769:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 202 00000100:00100000:3.0:1787692440.133923:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.134243:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108082176 00000100:00100000:1.0:1787692440.134257:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108082176 00000100:00100000:1.0:1787692440.134348:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:1.0:1787692440.134360:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+6:2361:x1874531108082176:12345-192.168.206.27@tcp:1:lfs.0 00010000:00010000:1.0:1787692440.134570:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.134599:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.134610:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692440.134615:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787692440.134621:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.134667:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.134684:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 6 pid: 6680 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692440.134720:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1874531125896960:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692440.134883:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692440.138253:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.138384:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108082304 00000100:00100000:0.0:1787692440.138395:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108082304 00002000:00100000:0.0:1787692440.138475:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff92ecb511fb80 x1874531108082304/t0(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:431/0 lens 504/0 e 0 to 0 dl 1787692451 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787692440.138488:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecb511fb80 with x1874531108082304 ext(0->8) 00010000:00010000:0.0:1787692440.138499:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 7 pid: 6680 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.138538:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 7 pid: 6680 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787692440.138547:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ecb511fb80 00000100:00100000:0.0:1787692440.138586:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:0.0:1787692440.138597:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2362:x1874531108082304:12345-192.168.206.27@tcp:4:lfs.0 00000100:00100000:0.0:1787692440.139248:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:067f46f5-4779-40e6-b53d-5b3e89751501+9:2362:x1874531108082304:12345-192.168.206.27@tcp:4:lfs.0 Request processed in 648us (1005us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787692440.139258:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 3 00002000:00100000:0.0:1787692440.139268:0:6685:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff92ecb511fb80 x1874531108082304/t4294967308(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:431/0 lens 504/448 e 0 to 0 dl 1787692451 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787692440.139277:0:6685:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecb511fb80 with x1874531108082304 ext(0->8) 00010000:00010000:0.0:1787692440.139284:0:6685:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 9 pid: 6680 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.139311:0:6685:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 9 pid: 6680 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787692440.139320:0:6685:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff92ecb511fb80 00000100:00100000:1.0:1787692440.140345:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6681:1874531125896960:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692440.140381:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692440.145747:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.146024:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108082432 00000100:00100000:0.0:1787692440.146037:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108082432 00010000:00010000:0.0:1787692440.146091:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 9 pid: 6680 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692440.146208:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 78 00000100:00100000:0.0:1787692440.146220:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+9:2361:x1874531108082432:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692440.146239:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787692440.146275:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787692440.146279:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787692439 00002000:00010000:0.0:1787692440.146282:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787692439 00002000:00010000:0.0:1787692440.146284:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787692439 00010000:00010000:0.0:1787692440.146290:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 9 pid: 6680 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.146316:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 9 pid: 6680 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.146345:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f1a9be1/0x5d8b8560a09df099 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b254c expref: 9 pid: 6680 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.146365:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787692440.146371:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787692440.146377:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.146388:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.146593:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692440.146673:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+8:2361:x1874531108082432:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 454us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692440.146682:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 78 00010000:00010000:1.0:1787692440.147276:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.147289:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.147333:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.147342:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.147351:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.147359:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165400 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692440.147364:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.147390:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.147427:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.147437:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dbef180/0x5d8b8560a09df0d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692440.147509:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108082176:12345-192.168.206.27@tcp:1:lfs.0 Request processed in 13150us (13598us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692440.147520:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:3.0:1787692440.151616:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.151776:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108082688 00000100:00100000:1.0:1787692440.151789:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108082688 00000100:00100000:1.0:1787692440.151907:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 56 00000100:00100000:1.0:1787692440.151920:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83553450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+43:11600:x1874531108082688:12345-192.168.206.27@tcp:35:lfs.0 00000004:00010000:1.0:1787692440.152003:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df0ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2561 expref: 43 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787692440.152365:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1787692440.152542:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787692440.153092:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787692440.153165:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.153187:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df084 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b253e expref: 47 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.153208:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.153254:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b253e expref: 47 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.153285:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b253e expref: 47 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692440.153311:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874531125897088:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692440.153409:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787692440.157956:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1874531125897088:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692440.157999:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692440.162748:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.165028:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108082816 00000100:00100000:1.0:1787692440.165049:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108082816 00010000:00010000:1.0:1787692440.165111:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b253e expref: 48 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692440.165566:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:1.0:1787692440.165583:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+48:2361:x1874531108082816:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787692440.165603:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692440.165612:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b253e expref: 48 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.165651:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b253e expref: 48 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.165679:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df084 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b253e expref: 48 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.165704:0:8440:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec94636000) 00010000:00010000:1.0:1787692440.165710:0:8440:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.165721:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.165730:0:8440:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.165876:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692440.165959:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+47:2361:x1874531108082816:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 380us (3226us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692440.165968:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 79 00010000:00010000:2.0:1787692440.170555:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.170580:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787692440.170784:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787692440.171080:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787692440.171232:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874531125897216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787692440.171351:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692440.171788:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125897216 00000100:00100000:2.0:1787692440.171798:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125897216 00000100:00100000:2.0:1787692440.171965:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787692440.171975:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1874531125897216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787692440.172061:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf937b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1874531125897216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 87us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692440.172068:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787692440.172094:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692440.172119:0:5834:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1787692440.172124:0:5834:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1787692440.172146:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92ecc5662a00, transno 4294967307 00000100:00100000:2.0:1787692440.172159:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874531125897216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787692440.173058:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787692440.173137:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874531125897344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787692440.173548:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692440.173591:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692440.173663:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125897344 00000100:00100000:3.0:1787692440.173672:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125897344 00000100:00100000:3.0:1787692440.173726:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787692440.173735:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5834:x1874531125897344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787692440.174130:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5834:x1874531125897344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 394us (581us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787692440.174139:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787692440.174317:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787692440.174532:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1874531125897344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1787692440.174688:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1787692440.174744:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.174757:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.174765:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.174772:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692440.174777:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.174785:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.174805:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec94636000) 00010000:00010000:0.0:1787692440.174808:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787692440.174944:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.174951:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165000/0x5d8b8560a09df0df lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787692440.175229:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787692440.175495:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1787692440.175511:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346381697884ns, next at 347381694151ns, rc = 0 00000001:00080000:0.0:1787692440.175536:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1787692440.175588:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec94636000) 00010000:00010000:0.0:1787692440.175592:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787692440.175601:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df0ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2561 expref: 51 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692440.175808:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83553450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+50:11600:x1874531108082688:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 23890us (24205us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1787692440.175856:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 56 00000020:00080000:0.0:1787692440.175863:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787692440.177720:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.177857:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108082944 00000100:00100000:0.0:1787692440.177869:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108082944 00000100:00100000:0.0:1787692440.177931:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 203 00000100:00100000:0.0:1787692440.177944:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+50:11600:x1874531108082944:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692440.177972:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692440.178000:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df0e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2568 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.178073:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df0e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2568 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.178090:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df0e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2568 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.178111:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692440.178114:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787692440.178118:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0c00, rc 0) 00000100:00100000:0.0:1787692440.178597:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+51:11600:x1874531108082944:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 652us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692440.178623:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 203 00000100:00100000:3.0:1787692440.181701:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.181927:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108083200 00000100:00100000:1.0:1787692440.181940:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108083200 00000100:00100000:1.0:1787692440.182007:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:1.0:1787692440.182031:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+51:11600:x1874531108083200:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:1.0:1787692440.182368:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+52:11600:x1874531108083200:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 340us (681us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787692440.182398:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 57 00000100:00100000:3.0:1787692440.290682:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.290914:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108083328 00000100:00100000:1.0:1787692440.290929:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108083328 00000100:00100000:1.0:1787692440.291223:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 204 00000100:00100000:1.0:1787692440.291238:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+52:11610:x1874531108083328:12345-192.168.206.27@tcp:34:lfs.0 00010000:00010000:1.0:1787692440.291360:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291382:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291395:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291412:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df0f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291439:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291447:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291607:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df0fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291616:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df0fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291632:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df0fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787692440.291718:0:8193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df0fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291741:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291748:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291760:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291766:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692440.291770:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291777:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291796:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:1.0:1787692440.291799:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692440.291804:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291857:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df0ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291877:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291884:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df0f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291904:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291909:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692440.291913:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291926:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291935:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec9dbfae00) 00010000:00010000:1.0:1787692440.291937:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692440.291941:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df0f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291953:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df0f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291976:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df0fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291983:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df0fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291989:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df0fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.291994:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692440.292254:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df0fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.292279:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df0fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.292289:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:1.0:1787692440.292304:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692440.292308:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df0fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.292315:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df0fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692440.292644:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+52:11610:x1874531108083328:12345-192.168.206.27@tcp:34:lfs.0 Request processed in 1406us (1984us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692440.292665:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 204 00000100:00100000:3.0:1787692440.345968:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.346139:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108083584 00000100:00100000:2.0:1787692440.346149:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108083584 00000100:00100000:2.0:1787692440.346211:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 205 00000100:00100000:2.0:1787692440.346222:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+52:11613:x1874531108083584:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692440.346241:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692440.346272:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df102 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b256f expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346368:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df109 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346382:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df109 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346555:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df109 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346574:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df110 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346581:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346589:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346716:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df117 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346726:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346733:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df117 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692440.346742:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787692440.346935:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df109 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346943:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df109 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346956:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df109 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346962:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692440.346967:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df109 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346974:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df109 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.346986:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:2.0:1787692440.346989:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692440.346994:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df109 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.347000:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df109 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.347013:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df110 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.347019:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df110 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.347023:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.347028:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692440.347031:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df110 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.347045:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df110 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.347052:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec94636f00) 00010000:00010000:2.0:1787692440.347054:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692440.347057:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df110 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.347062:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df110 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.347098:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df102 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b256f expref: 55 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.347110:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df117 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b256f expref: 54 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.347117:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692440.347119:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692440.347122:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3200, rc 0) 00000100:00100000:2.0:1787692440.348547:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+54:11613:x1874531108083584:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 2319us (2580us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787692440.348559:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 205 00000100:00100000:3.0:1787692440.353249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.353361:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108083712 00000100:00100000:0.0:1787692440.353378:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108083712 00000100:00100000:0.0:1787692440.353473:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 206 00000100:00100000:0.0:1787692440.353485:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+54:11613:x1874531108083712:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:0.0:1787692440.353578:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df125 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.353597:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.353611:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.353645:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df125 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.353653:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df125 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.353660:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.353666:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692440.353672:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df125 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.353680:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df125 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.353694:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692440.353715:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787692440.353722:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df125 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.353728:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1000/0x5d8b8560a09df125 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692440.353872:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+54:11613:x1874531108083712:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 388us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692440.353882:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 206 00000100:00100000:3.0:1787692440.355546:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.360977:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108083968 00000100:00100000:1.0:1787692440.360999:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108083968 00000100:00100000:1.0:1787692440.361140:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00100000:1.0:1787692440.361154:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+54:11613:x1874531108083968:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:1.0:1787692440.361497:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+55:11613:x1874531108083968:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 345us (5959us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1787692440.361517:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 58 00000100:00100000:3.0:1787692440.447332:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.447588:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108084224 00000100:00100000:1.0:1787692440.447602:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108084224 00000100:00100000:1.0:1787692440.447681:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 207 00000100:00100000:1.0:1787692440.447692:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+55:11623:x1874531108084224:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:1.0:1787692440.447723:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692440.447727:0:8193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787692440.447783:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2400/0x5d8b8560a09df0a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2553 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.447856:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:1.0:1787692440.447869:0:8193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787692440.447886:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df12c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2576 expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.448007:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.448022:0:8193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df117 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b256f expref: 55 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.448032:0:8193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.448072:0:8193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df117 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b256f expref: 55 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.448087:0:8193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df117 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b256f expref: 55 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692440.448103:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125897472:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692440.448214:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787692440.452691:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125897472:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692440.452738:0:8193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692440.453569:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.453769:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108084352 00000100:00100000:2.0:1787692440.453778:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108084352 00010000:00010000:2.0:1787692440.453846:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df117 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b256f expref: 56 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692440.453919:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00100000:2.0:1787692440.453930:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf681f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+56:2361:x1874531108084352:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692440.453949:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692440.453957:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df117 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b256f expref: 56 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.453970:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df117 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b256f expref: 56 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.453996:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df117 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b256f expref: 56 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.454016:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692440.454022:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.454032:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.454041:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.454078:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692440.454145:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf681f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+55:2361:x1874531108084352:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 217us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692440.454154:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 80 00010000:00010000:1.0:1787692440.454420:0:8193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.454429:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692440.454453:0:8193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787692440.454647:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df12c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2576 expref: 56 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.454667:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2576 expref: 55 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.454676:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:1.0:1787692440.454679:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787692440.454682:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164e00, rc 0) 00000100:00100000:1.0:1787692440.454715:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+55:11623:x1874531108084224:12345-192.168.206.27@tcp:101:bash.0 Request processed in 7025us (7901us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787692440.454723:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 207 00000100:00100000:3.0:1787692440.458478:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.460042:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108084608 00000100:00100000:2.0:1787692440.460090:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108084608 00000100:00100000:2.0:1787692440.460178:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 208 00000100:00100000:2.0:1787692440.460193:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+55:11623:x1874531108084608:12345-192.168.206.27@tcp:36:bash.0 00010000:00010000:2.0:1787692440.460598:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df141 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.460624:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df141 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.460638:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df141 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787692440.460703:0:8461:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1787692440.460730:0:8461:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5741a7d reply state 00000000ec7af836 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df141 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692440.460741:0:8461:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787692440.462163:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+58:11623:x1874531108084608:12345-192.168.206.27@tcp:36:bash.0 Request processed in 1959us (3688us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1787692440.462178:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 208 00000020:00080000:2.0:1787692440.462186:0:8461:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787692440.466890:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df141 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.466914:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df141 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.466924:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df141 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.466931:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692440.466938:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df141 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.466965:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df141 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.466990:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692440.466994:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692440.467000:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df141 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.467007:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df141 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692440.472471:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.479274:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108084736 00000100:00100000:2.0:1787692440.479305:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108084736 00000100:00100000:2.0:1787692440.479384:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 209 00000100:00100000:2.0:1787692440.479397:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+57:11623:x1874531108084736:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1787692440.479432:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692440.479458:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df148 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b257d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.479600:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.479619:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2576 expref: 58 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.479628:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.479670:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2576 expref: 58 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.479693:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2576 expref: 58 pid: 8193 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692440.479709:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125897600:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692440.479849:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca9180 going to sleep for 11 seconds 00000100:00100000:2.0:1787692440.483117:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125897600:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692440.483152:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692440.483523:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.483612:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108084864 00000100:00100000:2.0:1787692440.483620:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108084864 00010000:00010000:2.0:1787692440.483663:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2576 expref: 59 pid: 8193 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692440.483708:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 81 00000100:00100000:2.0:1787692440.483717:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+59:2362:x1874531108084864:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692440.483735:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692440.483742:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2576 expref: 59 pid: 8193 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.483756:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2576 expref: 59 pid: 8193 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.483783:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df133 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2576 expref: 59 pid: 8193 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.483874:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692440.483880:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.483890:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.483898:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.483919:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692440.483978:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+58:2362:x1874531108084864:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 261us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692440.483985:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 81 00010000:00010000:0.0:1787692440.484197:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.484206:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692440.484263:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787692440.484268:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692440.484304:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.484342:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df148 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b257d expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.484362:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b257d expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.484371:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692440.484374:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692440.484386:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3a00, rc 0) 00000100:00100000:0.0:1787692440.484428:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+57:11623:x1874531108084736:12345-192.168.206.27@tcp:101:bash.0 Request processed in 5034us (11973us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692440.484436:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 209 00000100:00100000:0.0:1787692440.486783:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.486969:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108085120 00000100:00100000:2.0:1787692440.486979:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108085120 00000100:00100000:2.0:1787692440.487042:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:2.0:1787692440.487053:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+57:11623:x1874531108085120:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:2.0:1787692440.487352:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf917800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+58:11623:x1874531108085120:12345-192.168.206.27@tcp:35:bash.0 Request processed in 300us (579us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787692440.487361:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 59 00000100:00100000:3.0:1787692440.574764:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.574896:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108085248 00000100:00100000:1.0:1787692440.574905:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108085248 00000100:00100000:1.0:1787692440.574959:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 210 00000100:00100000:1.0:1787692440.574970:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+58:11629:x1874531108085248:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692440.574993:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692440.575014:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df156 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2584 expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.575094:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df15d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.575108:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.575119:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692440.575174:0:8193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787692440.575178:0:8193:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692440.575199:0:8193:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.575225:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df156 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2584 expref: 60 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.575242:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df15d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2584 expref: 59 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.575251:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:1.0:1787692440.575253:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787692440.575257:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165400, rc 0) 00000100:00100000:1.0:1787692440.575321:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+59:11629:x1874531108085248:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 353us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692440.575329:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 210 00000100:00100000:3.0:1787692440.578097:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.578370:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108085376 00000100:00100000:2.0:1787692440.578386:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108085376 00000100:00100000:2.0:1787692440.578467:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 211 00000100:00100000:2.0:1787692440.578481:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+59:11629:x1874531108085376:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692440.578517:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692440.578561:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df164 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b258b expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.578646:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df16b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.578665:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df16b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.578678:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df16b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.578695:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.578704:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.578711:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.578992:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579002:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579010:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692440.579053:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787692440.579058:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692440.579149:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579171:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579180:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df16b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579186:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df16b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579192:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df16b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579199:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692440.579203:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df16b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579211:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df16b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579283:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:2.0:1787692440.579287:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692440.579302:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df16b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579310:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df16b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579327:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579334:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df172 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579347:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579353:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692440.579356:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579363:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579372:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec94636f00) 00010000:00010000:2.0:1787692440.579374:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692440.579378:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df172 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579383:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579424:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df164 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b258b expref: 61 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579438:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b258b expref: 60 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.579445:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692440.579447:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692440.579450:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3600, rc 0) 00000100:00100000:2.0:1787692440.579682:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+60:11629:x1874531108085376:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1202us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692440.579703:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 211 00000100:00100000:0.0:1787692440.586506:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.586571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.586678:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108085632 00000100:00100000:2.0:1787692440.586693:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108085632 00000100:00100000:2.0:1787692440.586767:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 212 00000100:00100000:2.0:1787692440.586779:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+60:11629:x1874531108085632:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692440.586804:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692440.586859:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2592 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.586988:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.587007:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b257d expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.587016:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b258b expref: 61 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.587025:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692440.587273:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108085760 00000100:00100000:3.0:1787692440.587278:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108085760 00010000:00010000:3.0:1787692440.587320:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b258b expref: 62 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.587595:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b258b expref: 62 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.587612:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b258b expref: 62 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692440.587630:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125897728:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692440.587849:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:3.0:1787692440.587859:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec902ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+62:2361:x1874531108085760:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692440.587872:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692440.587885:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b258b expref: 62 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692440.587898:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b258b expref: 62 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692440.587920:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:3.0:1787692440.587924:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692440.587931:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692440.587937:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787692440.588076:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b257d expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.588087:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b257d expref: 62 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692440.588096:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125897856:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692440.589623:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec902ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+62:2361:x1874531108085760:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 1750us (3034us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692440.589639:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:2.0:1787692440.590761:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca9180 going to sleep for 11 seconds 00000100:00100000:0.0:1787692440.606619:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.606794:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108085888 00000100:00100000:1.0:1787692440.606806:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108085888 00010000:00010000:1.0:1787692440.606914:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b257d expref: 62 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692440.606962:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 83 00000100:00100000:1.0:1787692440.606973:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+62:2362:x1874531108085888:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787692440.606994:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692440.607003:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b257d expref: 62 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.607020:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b257d expref: 62 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.607048:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:1.0:1787692440.607053:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.607065:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.607073:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.607096:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692440.607176:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf915500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+62:2362:x1874531108085888:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 203us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692440.607185:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 83 00010000:00010000:2.0:1787692440.607709:0:5832:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.27@tcp) returned -22 from blocking AST (req@00000000c4754b1b x1874531125897728) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b258b expref: 61 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.607728:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b258b expref: 61 pid: 8461 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692440.607748:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125897728:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692440.607764:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df14f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b257d expref: 60 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692440.607774:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1874531125897856:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692440.607796:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692440.607804:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.607848:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.607873:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692440.607898:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787692440.610510:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2592 expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.610541:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2592 expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.610551:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692440.610555:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787692440.610559:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2a00, rc 0) 00000100:00100000:2.0:1787692440.610649:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf915f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+60:11629:x1874531108085632:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 23871us (24157us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787692440.610661:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 212 00000100:00100000:0.0:1787692440.624209:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.624540:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108086144 00000100:00100000:1.0:1787692440.624549:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108086144 00000100:00100000:1.0:1787692440.624650:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:1.0:1787692440.624672:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+60:11629:x1874531108086144:12345-192.168.206.27@tcp:103:lfs.0 00010000:00010000:1.0:1787692440.624687:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692440.624710:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df0e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2568 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.624729:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:1.0:1787692440.624734:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692440.624790:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf916680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:067f46f5-4779-40e6-b53d-5b3e89751501+59:11629:x1874531108086144:12345-192.168.206.27@tcp:103:lfs.0 Request processed in 120us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692440.624797:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:3.0:1787692440.632377:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.632706:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108086272 00000100:00100000:2.0:1787692440.632717:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108086272 00000100:00100000:2.0:1787692440.632781:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 213 00000100:00100000:2.0:1787692440.632791:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+59:11629:x1874531108086272:12345-192.168.206.27@tcp:58:lfs.0 00010000:00010000:2.0:1787692440.632921:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df195 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.632937:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.632949:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787692440.633199:0:8193:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1787692440.633279:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+59:11629:x1874531108086272:12345-192.168.206.27@tcp:58:lfs.0 Request processed in 489us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692440.633287:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 213 00000100:00100000:0.0:1787692440.636545:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.636637:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108086400 00000100:00100000:2.0:1787692440.636646:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108086400 00000100:00100000:2.0:1787692440.636704:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 214 00000100:00100000:2.0:1787692440.636714:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+59:11629:x1874531108086400:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692440.636733:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692440.636751:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df19c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2599 expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.636803:0:8461:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df195 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.636938:0:8461:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df19c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2599 expref: 60 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.636958:0:8461:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.637193:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df19c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2599 expref: 60 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.637209:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692440.637212:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787692440.637216:0:8461:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df19c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2599 expref: 60 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.637231:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3a00, rc 0) 00000100:00100000:2.0:1787692440.637386:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+60:11629:x1874531108086400:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 672us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692440.637393:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 214 00000100:00100000:3.0:1787692440.737694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692440.737764:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.737851:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108086528 00000100:00100000:2.0:1787692440.737860:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108086528 00000100:00100000:1.0:1787692440.737871:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108086656 00000100:00100000:1.0:1787692440.737882:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108086656 00000100:00100000:2.0:1787692440.737919:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 288 00000100:00100000:2.0:1787692440.737930:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108086528:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692440.737941:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 83 00000100:00100000:1.0:1787692440.737950:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108086656:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692440.738029:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108086656:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 80us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692440.738037:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 83 00000100:00100000:2.0:1787692440.738447:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:2362:x1874531108086528:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 518us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692440.738455:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 288 00000100:00100000:0.0:1787692440.738621:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.738754:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108086784 00000100:00100000:1.0:1787692440.738760:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108086784 00000100:00080000:0.0:1787692440.738856:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787692440.738973:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:1.0:1787692440.738983:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+9:2362:x1874531108086784:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692440.739016:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+9:2362:x1874531108086784:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 36us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692440.739022:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:0.0:1787692440.747930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.748127:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108086912 00000100:00100000:2.0:1787692440.748135:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108086912 00000100:00100000:2.0:1787692440.748204:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 141 00000100:00100000:2.0:1787692440.748214:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2361:x1874531108086912:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692440.748305:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2361:x1874531108086912:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 92us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692440.748313:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 141 00000100:00080000:0.0:1787692440.748552:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1787692440.769275:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787692440.769284:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787692440.769332:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:2.0:1787692440.769338:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787692440.769739:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874531125897984:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787692440.769907:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb87ca9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787692440.774776:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.774929:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874531125897984:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787692440.775241:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108087040 00000100:00100000:1.0:1787692440.775271:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108087040 00000100:00100000:1.0:1787692440.775333:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 215 00000100:00100000:1.0:1787692440.775342:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+60:11630:x1874531108087040:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787692440.775369:0:5831:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787692440.775463:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+60:11630:x1874531108087040:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 122us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692440.775471:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 215 00000100:00100000:3.0:1787692440.779104:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.779495:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108087168 00000100:00100000:2.0:1787692440.779505:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108087168 00000100:00100000:2.0:1787692440.779577:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 216 00000100:00100000:2.0:1787692440.779588:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+60:11630:x1874531108087168:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787692440.779658:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df1a3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779674:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df1a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779686:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df1a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779702:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779710:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779717:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779737:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df1b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779745:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779751:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692440.779803:0:8461:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787692440.779808:0:8461:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692440.779849:0:8461:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779860:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df1a3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779867:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df1a3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779873:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df1a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779879:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692440.779883:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df1a3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779891:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df1a3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779902:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec832f4e00) 00010000:00010000:2.0:1787692440.779905:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692440.779909:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df1a3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779916:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df1a3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779930:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779947:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1aa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779953:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779971:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692440.779974:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779981:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1aa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.779990:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff92ec94636f00) 00010000:00010000:2.0:1787692440.779992:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692440.779995:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1aa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.780002:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1aa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.780018:0:8461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df1b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.780024:0:8461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df1b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.780029:0:8461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.780034:0:8461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692440.780043:0:8461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df1b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.780050:0:8461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df1b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.780058:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692440.780060:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692440.780064:0:8461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df1b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.780070:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df1b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692440.780144:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+60:11630:x1874531108087168:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 Request processed in 557us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692440.780152:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 216 00000100:00100000:0.0:1787692440.785105:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.785317:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108087424 00000100:00100000:1.0:1787692440.785328:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108087424 00000100:00100000:1.0:1787692440.785387:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 217 00000100:00100000:1.0:1787692440.785397:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+60:11630:x1874531108087424:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787692440.785415:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692440.785434:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df1b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b25a0 expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.785529:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df1bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.785543:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.785566:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692440.785577:0:8193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787692440.785674:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df1bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.785682:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df1bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.785698:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df1bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.785704:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692440.785708:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df1bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.785716:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df1bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.785728:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:1.0:1787692440.785731:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787692440.785736:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df1bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.785742:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df1bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.785780:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df1b8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25a0 expref: 62 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.785789:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec832f4e00) 00010000:00010000:1.0:1787692440.785792:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787692440.785795:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165c00/0x5d8b8560a09df1b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25a0 expref: 62 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.785805:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165c00, rc 0) 00000100:00100000:1.0:1787692440.785913:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+61:11630:x1874531108087424:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 516us (815us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1787692440.785931:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 217 00000100:00100000:3.0:1787692440.789922:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.790186:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108087552 00000100:00100000:0.0:1787692440.790195:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108087552 00000100:00100000:0.0:1787692440.790249:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 218 00000100:00100000:0.0:1787692440.790259:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+61:11630:x1874531108087552:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787692440.790312:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787692440.790409:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+61:11630:x1874531108087552:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 151us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692440.790417:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 218 00000100:00100000:3.0:1787692440.794848:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.795103:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108087808 00000100:00100000:0.0:1787692440.795112:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108087808 00000100:00100000:0.0:1787692440.795170:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 219 00000100:00100000:0.0:1787692440.795180:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+61:11630:x1874531108087808:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787692440.795210:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692440.795213:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787692440.795241:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165400/0x5d8b8560a09df15d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2584 expref: 61 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.795267:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:0.0:1787692440.795272:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787692440.795285:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df1cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b25a7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787692440.795678:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1787692440.796176:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09df1d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.796190:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09df1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.796199:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09df1d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.796249:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df1cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25a7 expref: 63 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.796264:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09df1d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25a7 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.796273:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ec832f4000) 00010000:00010000:0.0:1787692440.796276:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692440.796286:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1a00, rc 0) 00000100:00100000:0.0:1787692440.796363:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+62:11630:x1874531108087808:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 1183us (1554us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1787692440.796372:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 219 00000100:00100000:3.0:1787692440.800300:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.800449:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108088064 00000100:00100000:0.0:1787692440.800459:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108088064 00000100:00100000:0.0:1787692440.800514:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 220 00000100:00100000:0.0:1787692440.800525:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+62:11630:x1874531108088064:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787692440.800581:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692440.800606:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1a00/0x5d8b8560a09df1d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25a7 expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800623:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ec832f4000) 00010000:00010000:0.0:1787692440.800632:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787692440.800651:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df1e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800663:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df1e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800672:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df1e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800686:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df1e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x47689555 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800693:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x47689555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800700:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x47689555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800780:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df1e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800788:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df1e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800795:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df1e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800802:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692440.800807:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df1e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800839:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df1e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800848:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:0.0:1787692440.800851:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692440.800855:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df1e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800861:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df1e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800870:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df1e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x47689555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800876:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df1e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x47689555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800883:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x47689555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800895:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692440.800898:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df1e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x47689555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800904:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df1e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x47689555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800913:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x47689555 (ffff92ec832f4c00) 00010000:00010000:0.0:1787692440.800915:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692440.800918:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df1e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x47689555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.800924:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df1e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x47689555 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692440.801219:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+61:11630:x1874531108088064:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 694us (934us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787692440.801228:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 220 00000100:00100000:1.0:1787692440.804159:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.804275:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108088192 00000100:00100000:2.0:1787692440.804284:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108088192 00000100:00100000:2.0:1787692440.804339:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 221 00000100:00100000:2.0:1787692440.804348:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+61:11630:x1874531108088192:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692440.804364:0:8461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692440.804384:0:8461:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df1f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b25ae expref: -99 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.804427:0:8461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.804439:0:8461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.804468:0:8461:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8461 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.804583:0:8461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df1f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ae expref: 63 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.804601:0:8461:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ae expref: 62 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.804609:0:8461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ec94636f00) 00010000:00010000:2.0:1787692440.804612:0:8461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787692440.804615:0:8461:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2800, rc 0) 00000100:00100000:2.0:1787692440.804665:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+62:11630:x1874531108088192:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 318us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692440.804671:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 221 00000100:00100000:3.0:1787692440.809858:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.810325:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108088448 00000100:00100000:0.0:1787692440.810335:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108088448 00000100:00100000:0.0:1787692440.810391:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 222 00000100:00100000:0.0:1787692440.810401:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+62:11630:x1874531108088448:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787692440.810501:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df1fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.810516:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df1fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.810527:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df1fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787692440.810763:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1787692440.810774:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347016960680ns, next at 348016957676ns, rc = 0 00000004:00010000:0.0:1787692440.810904:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d6ae482 reply state 0000000053d20ee0 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df1fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692440.810914:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787692440.811432:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+64:11630:x1874531108088448:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 1030us (1622us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1787692440.811441:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 222 00000100:00100000:3.0:1787692440.815199:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.815509:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108088576 00000100:00100000:0.0:1787692440.815519:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108088576 00000100:00100000:0.0:1787692440.815577:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 223 00000100:00100000:0.0:1787692440.815588:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+64:11630:x1874531108088576:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787692440.815611:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692440.815630:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df205 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b25b5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.815687:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df205 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25b5 expref: 65 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.815702:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df205 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25b5 expref: 65 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.815722:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ec94636f00) 00010000:00010000:0.0:1787692440.815725:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787692440.815729:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0c00, rc 0) 00000100:00100000:0.0:1787692440.815802:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+65:11630:x1874531108088576:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 215us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692440.815809:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 223 00000100:00100000:2.0:1787692440.819245:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692440.819421:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108088704 00000100:00100000:3.0:1787692440.819431:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108088704 00000100:00100000:3.0:1787692440.819481:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 62 00000100:00100000:3.0:1787692440.819502:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+9:2362:x1874531108088704:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787692440.819762:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+10:2362:x1874531108088704:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 260us (524us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787692440.819769:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 62 00010000:00010000:1.0:1787692440.820941:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df1fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.820955:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df1fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.820971:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df1fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.820977:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692440.820982:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df1fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.820990:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df1fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.821006:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ec94636f00) 00010000:00010000:1.0:1787692440.821009:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787692440.821014:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df1fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.821020:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df1fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692440.823088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.823157:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108088960 00000100:00100000:2.0:1787692440.823166:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108088960 00000100:00100000:2.0:1787692440.823218:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:2.0:1787692440.823227:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+64:11630:x1874531108088960:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787692440.823582:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+65:11630:x1874531108088960:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 354us (724us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1787692440.823590:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 60 00000100:00100000:2.0:1787692440.829682:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.829790:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108089216 00000100:00100000:1.0:1787692440.829799:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108089216 00000100:00100000:1.0:1787692440.829898:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 224 00000100:00100000:1.0:1787692440.829909:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+65:11630:x1874531108089216:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787692440.830160:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+65:11630:x1874531108089216:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 252us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692440.830168:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 224 00000100:00100000:3.0:1787692440.834572:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.838626:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108089344 00000100:00100000:0.0:1787692440.838641:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108089344 00000100:00100000:0.0:1787692440.838714:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 225 00000100:00100000:0.0:1787692440.838725:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+65:11630:x1874531108089344:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787692440.838745:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692440.838766:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df20c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b25bc expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.838847:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df213 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.838860:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.838871:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692440.838904:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692440.838920:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df213 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.838943:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df20c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25bc expref: 67 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.839753:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df213 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25bc expref: 66 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.839787:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ec94636f00) 00010000:00010000:0.0:1787692440.839790:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787692440.839794:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1200, rc 0) 00000100:00100000:0.0:1787692440.839897:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+66:11630:x1874531108089344:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 1172us (5332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692440.839905:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 225 00000100:00100000:3.0:1787692440.843482:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692440.844136:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108089472 00000100:00100000:2.0:1787692440.844146:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108089472 00000100:00100000:2.0:1787692440.844208:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:2.0:1787692440.844218:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+10:2361:x1874531108089472:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692440.844235:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692440.844255:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df21a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b25c3 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787692440.844302:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8e0598, blocks: 0x1 00010000:00010000:2.0:1787692440.844320:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1787692440.844324:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692440.844334:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df21a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25c3 expref: 11 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.844353:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df21a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25c3 expref: 11 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.844365:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3200, rc 0) 00000100:00100000:2.0:1787692440.844533:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+11:2361:x1874531108089472:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 315us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692440.844540:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:2.0:1787692440.849930:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692440.850055:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108089728 00000100:00100000:3.0:1787692440.850064:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108089728 00000100:00100000:3.0:1787692440.850117:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 226 00000100:00100000:3.0:1787692440.850126:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+66:11630:x1874531108089728:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787692440.850224:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+66:11630:x1874531108089728:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692440.850231:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 226 00000100:00100000:3.0:1787692440.859379:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.859909:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108089856 00000100:00100000:1.0:1787692440.859919:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108089856 00000100:00100000:1.0:1787692440.860089:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:1.0:1787692440.860100:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+11:11630:x1874531108089856:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787692440.860119:0:6679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692440.860139:0:6679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09df221 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b25ca expref: -99 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.860194:0:6679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df21a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25c3 expref: 12 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.860204:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692440.860208:0:6679:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692440.860213:0:6679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09df221 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ca expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.860252:0:6679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df21a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25c3 expref: 12 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.860278:0:6679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df21a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25c3 expref: 12 pid: 6681 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692440.860303:0:6679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874531125898112:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692440.860394:0:6679:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787692440.864242:0:6679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6679:1874531125898112:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692440.864300:0:6679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09df221 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ca expref: 12 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692440.864320:0:6679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165a00, rc 0) 00000100:00100000:1.0:1787692440.864379:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:067f46f5-4779-40e6-b53d-5b3e89751501+12:11630:x1874531108089856:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 4280us (5007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692440.864387:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:3.0:1787692440.866254:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.866848:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108089984 00000100:00100000:0.0:1787692440.866856:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108089984 00010000:00010000:0.0:1787692440.866895:0:8440:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df21a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25c3 expref: 12 pid: 6681 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692440.866939:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:0.0:1787692440.866949:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf680700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+12:2361:x1874531108089984:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692440.866961:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692440.866983:0:8440:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df21a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25c3 expref: 12 pid: 6681 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.866997:0:8440:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df21a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25c3 expref: 12 pid: 6681 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.867020:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df21a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25c3 expref: 12 pid: 6681 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.867036:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692440.867052:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692440.867060:0:8440:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09df221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ca expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.867071:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09df221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ca expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.867107:0:8440:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09df221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ca expref: 11 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692440.867120:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8440:1874531125898240:192.168.206.27@tcp:105: 00000100:00100000:0.0:1787692440.867196:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec87d9e780 going to sleep for 11 seconds 00000100:00100000:0.0:1787692440.872311:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8440:1874531125898240:192.168.206.27@tcp:105: 00010000:00010000:0.0:1787692440.872336:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692440.872391:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf680700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:067f46f5-4779-40e6-b53d-5b3e89751501+11:2361:x1874531108089984:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 5444us (6439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692440.872403:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:3.0:1787692440.880028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.880188:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108090112 00000100:00100000:1.0:1787692440.880197:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108090112 00002000:00100000:1.0:1787692440.880246:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff92ecb511d500 x1874531108090112/t0(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:431/0 lens 504/0 e 0 to 0 dl 1787692451 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787692440.880268:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecb511d500 with x1874531108090112 ext(0->12) 00002000:00010000:1.0:1787692440.880274:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecb511d500 00000100:00100000:1.0:1787692440.880313:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:1.0:1787692440.880323:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:067f46f5-4779-40e6-b53d-5b3e89751501+11:2362:x1874531108090112:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787692440.880750:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:067f46f5-4779-40e6-b53d-5b3e89751501+13:2362:x1874531108090112:12345-192.168.206.27@tcp:4:lhsmtool_posix.0 Request processed in 427us (731us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787692440.880759:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00002000:00100000:1.0:1787692440.880767:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff92ecb511d500 x1874531108090112/t4294967320(0) o4->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:431/0 lens 504/448 e 0 to 0 dl 1787692451 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787692440.880776:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecb511d500 with x1874531108090112 ext(0->12) 00002000:00010000:1.0:1787692440.880779:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecb511d500 00000100:00100000:2.0:1787692440.883624:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692440.883795:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108090240 00000100:00100000:1.0:1787692440.883804:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108090240 00000100:00100000:1.0:1787692440.884053:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 227 00000100:00100000:1.0:1787692440.884063:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+66:11630:x1874531108090240:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787692440.961685:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+66:11630:x1874531108090240:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 Request processed in 77612us (78058us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692440.961699:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 227 00000001:00080000:3.0:1787692440.962206:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1787692440.962213:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:3.0:1787692440.962235:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1787692440.962249:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000100:00100000:1.0:1787692440.962506:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125898368:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787692440.962561:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:3.0:1787692440.962696:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000100:00100000:2.0:1787692440.962946:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125898368 00000100:00100000:2.0:1787692440.962955:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125898368 00000100:00100000:2.0:1787692440.963018:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787692440.963027:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1874531125898368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787692440.963051:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1787692440.963082:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8e0597, atime: 0x6a8e0597, ctime: 0x6a8e0597, blocks: 0x1 00010000:00010000:2.0:1787692440.963090:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b627c7/0x5d8b8560a09df228 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.963105:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1787692440.963109:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692440.963115:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b627c7/0x5d8b8560a09df228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.963130:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b627c7/0x5d8b8560a09df228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.963140:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b627c7/0x5d8b8560a09df228 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.963147:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b627c7/0x5d8b8560a09df228 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.963166:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1787692440.963404:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92ec87d9e840 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787692440.963409:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ecaeecd900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92ec87d9ecc0 00000020:00080000:3.0:1787692440.963413:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ecaeecd000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92ecb4fe7400 00000020:00080000:1.0:1787692440.963455:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1787692440.963518:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92ec87d9e3c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787692440.963527:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ecaef65900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92ec87d9ef00 00000020:00080000:3.0:1787692440.963530:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ecaef65c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92ecb5156800 00000020:00080000:1.0:1787692440.963566:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1787692440.963869:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1787692440.964114:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125898624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787692440.964163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692440.964233:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125898496:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787692440.964272:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692440.964703:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1874531125898368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1676us (2140us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787692440.964711:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1787692440.965617:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692440.965628:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b627c7/0x5d8b8560a09df228 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692440.965640:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692440.965645:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b627c7/0x5d8b8560a09df228 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692440.965655:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b627c7/0x5d8b8560a09df228 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692440.965679:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b627c7/0x5d8b8560a09df228 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692440.965687:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b627c7/0x5d8b8560a09df228 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692440.965712:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692440.965714:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692440.965716:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787692440.966636:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92ecaf1c5f80/2, rc 0, transno 4294967310 00000100:00100000:1.0:1787692440.966648:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125898368:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787692440.966932:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125898624 00000100:00100000:2.0:1787692440.966940:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125898624 00000100:00100000:2.0:1787692440.967048:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125898496 00000100:00100000:2.0:1787692440.967052:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125898496 00000100:00100000:2.0:1787692440.967068:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787692440.967076:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaef1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1874531125898624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787692440.967230:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787692440.967233:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787692440 00002000:00010000:2.0:1787692440.967236:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787692440.967238:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787692440 -> 1787692440 00002000:00010000:2.0:1787692440.967240:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787692440.967315:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaef1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3305:x1874531125898624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 238us (3151us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787692440.967322:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787692440.967450:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787692440.967458:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874531125898496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787692440.967472:0:6681:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1787692440.967487:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.967505:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009649b70d/0x5d8b8560a09defea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2529 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.967513:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787692440.967517:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787692440.967522:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.967549:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009649b70d/0x5d8b8560a09defea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2529 expref: 12 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.967572:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009649b70d/0x5d8b8560a09defea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2529 expref: 12 pid: 6680 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692440.967586:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1874531125898752:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692440.967642:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec85f4ab40 going to sleep for 11 seconds 00000100:00080000:1.0:1787692440.968230:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1787692440.968357:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92ecaf686300/2, rc 0, transno 4294967321 00000100:00100000:3.0:1787692440.968365:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125898624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787692440.968398:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.968482:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108090368 00000100:00100000:0.0:1787692440.968487:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108090368 00000100:00100000:1.0:1787692440.968533:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:1.0:1787692440.968542:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+13:2364:x1874531108090368:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787692440.971864:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1874531125898752:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692440.975482:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692440.990856:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692440.992577:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108090496 00000100:00100000:0.0:1787692440.992592:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108090496 00010000:00010000:0.0:1787692440.992644:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009649b70d/0x5d8b8560a09defea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2529 expref: 14 pid: 6680 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692440.992693:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:0.0:1787692440.992703:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+14:2361:x1874531108090496:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692440.992743:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692440.992750:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009649b70d/0x5d8b8560a09defea lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2529 expref: 14 pid: 6680 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.992763:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009649b70d/0x5d8b8560a09defea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2529 expref: 14 pid: 6680 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.992786:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009649b70d/0x5d8b8560a09defea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2529 expref: 14 pid: 6680 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.992802:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787692440.992807:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787692440.992848:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.992859:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.992882:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692440.992937:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+13:2361:x1874531108090496:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 234us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692440.992944:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 85 00010000:00010000:2.0:1787692440.995923:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.995942:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.995954:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.995962:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692440.995996:0:6681:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787692440.996586:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3304:x1874531125898496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 29125us (32309us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787692440.996596:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1787692440.996723:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692440.996730:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.996754:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692440.996759:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.996768:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.996786:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.996792:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df22f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692440.996850:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692440.996853:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692440.996854:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787692440.998973:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92ecaf687800/2, rc 0, transno 4294967322 00000100:00100000:1.0:1787692440.998986:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125898496:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1787692441.060924:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:0.0:1787692441.060954:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1787692441.061165:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:2364:x1874531108090368:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 Request processed in 92618us (92761us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692441.061175:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:0.0:1787692441.067851:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692441.068037:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108090752 00000100:00100000:2.0:1787692441.068047:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108090752 00000100:00100000:2.0:1787692441.068214:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 228 00000100:00100000:2.0:1787692441.068226:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+20:11630:x1874531108090752:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787692441.068301:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692441.068328:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1200/0x5d8b8560a09df213 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25bc expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.068347:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ec94636f00) 00010000:00010000:2.0:1787692441.068351:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787692441.068381:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df236 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.068393:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.068402:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787692441.068626:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a5c95cb reply state 000000005a44efe8 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692441.068636:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787692441.068730:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+21:11630:x1874531108090752:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 506us (1009us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787692441.068737:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 228 00010000:00010000:2.0:1787692441.071622:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df236 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.071639:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df236 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.071663:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df236 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.071670:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692441.071675:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df236 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.071683:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df236 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.071698:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ec94636f00) 00010000:00010000:2.0:1787692441.071702:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692441.071706:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df236 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.071712:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df236 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692441.073880:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692441.073953:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108090880 00000100:00100000:3.0:1787692441.073962:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108090880 00000100:00100000:3.0:1787692441.074018:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:3.0:1787692441.074029:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2362:x1874531108090880:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787692441.074228:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787692441.074233:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787692440 -> 1787692440 00002000:00010000:3.0:1787692441.074236:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787692439 00002000:00010000:3.0:1787692441.074238:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787692440 -> 1787692440 00002000:00010000:3.0:1787692441.074240:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787692441.074316:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+8:2362:x1874531108090880:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 288us (443us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787692441.074324:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00080000:1.0:1787692441.075601:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692441.079467:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692441.079849:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108091136 00000100:00100000:1.0:1787692441.079861:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108091136 00000100:00100000:1.0:1787692441.079910:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 229 00000100:00100000:1.0:1787692441.079935:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+20:11630:x1874531108091136:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787692441.080002:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.080018:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ae expref: 20 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.080026:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.080058:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ae expref: 20 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.080071:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ae expref: 20 pid: 8461 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692441.080084:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125898880:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692441.080170:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfb300 going to sleep for 11 seconds 00000100:00100000:0.0:1787692441.082489:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692441.082683:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108091264 00000100:00100000:2.0:1787692441.082692:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108091264 00010000:00010000:2.0:1787692441.082731:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1f7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ae expref: 21 pid: 8461 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692441.082762:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00100000:2.0:1787692441.082772:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf686680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+21:2362:x1874531108091264:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692441.082786:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692441.082793:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1f7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ae expref: 21 pid: 8461 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.082873:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ae expref: 21 pid: 8461 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.082894:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ec94636f00) 00010000:00010000:2.0:1787692441.082900:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.082908:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.082916:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.082935:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692441.082975:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf686680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+21:2362:x1874531108091264:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 205us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692441.082982:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 86 00010000:00010000:1.0:1787692441.083457:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df1f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ae expref: 20 pid: 8461 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692441.083475:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125898880:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692441.083497:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.083505:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.083521:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.083547:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.083567:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.083574:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.083580:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692441.083584:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.083591:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.083601:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ec94636f00) 00010000:00010000:1.0:1787692441.083604:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1787692441.083607:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.083613:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df23d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692441.083667:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+19:11630:x1874531108091136:12345-192.168.206.27@tcp:55:lhsmtool_posix.0 Request processed in 3734us (4209us total) trans 0 rc -22/-22 00000100:00100000:1.0:1787692441.083675:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 229 00000100:00100000:0.0:1787692441.085912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692441.086006:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108091392 00000100:00100000:2.0:1787692441.086015:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108091392 00000100:00100000:2.0:1787692441.086067:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:2.0:1787692441.086076:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+8:2363:x1874531108091392:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787692441.086114:0:6681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.086132:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09df221 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ca expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.086157:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692441.086162:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787692441.086166:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.086202:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09df221 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ca expref: 8 pid: 6679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.086216:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09df221 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ca expref: 8 pid: 6679 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692441.086231:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1874531125899008:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692441.086312:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec85f4a180 going to sleep for 11 seconds 00000100:00100000:0.0:1787692441.089283:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00010000:00010000:1.0:1787692441.089384:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692441.089470:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108091520 00000100:00100000:3.0:1787692441.089479:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108091520 00010000:00010000:3.0:1787692441.089513:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09df221 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ca expref: 9 pid: 6679 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692441.089551:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 87 00000100:00100000:3.0:1787692441.089561:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+9:2362:x1874531108091520:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692441.089574:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692441.089608:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09df221 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ca expref: 9 pid: 6679 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.089621:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09df221 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ca expref: 9 pid: 6679 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.089640:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787692441.089645:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787692441.089650:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.089659:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.089677:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692441.089727:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+9:2362:x1874531108091520:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 167us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692441.089734:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 87 00010000:00010000:2.0:1787692441.089989:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052291faf/0x5d8b8560a09df221 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ca expref: 8 pid: 6679 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692441.090004:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6681:1874531125899008:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692441.090024:0:6681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.090034:0:6681:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.090041:0:6681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.090072:0:6681:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.090080:0:6681:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.090088:0:6681:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.090096:0:6681:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692441.090100:0:6681:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.090109:0:6681:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.090121:0:6681:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.090128:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005b627c7/0x5d8b8560a09df244 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692441.090174:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+7:2363:x1874531108091392:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 Request processed in 4099us (4271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692441.090182:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 70 00000100:00100000:0.0:1787692441.093068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692441.096799:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108091776 00000100:00100000:2.0:1787692441.096829:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108091776 00000100:00100000:0.0:1787692441.097033:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 230 00000100:00100000:0.0:1787692441.097057:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+19:11630:x1874531108091776:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787692441.097128:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df24b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.097144:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df24b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.097155:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df24b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.097437:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.097449:0:8193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df205 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25b5 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.097457:0:8193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.097488:0:8193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df205 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25b5 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.097501:0:8193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df205 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25b5 expref: 20 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692441.097514:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125899136:192.168.206.27@tcp:104: 00000100:00100000:0.0:1787692441.097701:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90326d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787692441.100580:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692441.100661:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108091904 00000100:00100000:2.0:1787692441.100669:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108091904 00010000:00010000:2.0:1787692441.100705:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df205 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25b5 expref: 21 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692441.100743:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 88 00000100:00100000:2.0:1787692441.100752:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec886a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+21:2361:x1874531108091904:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692441.100765:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692441.100772:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df205 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25b5 expref: 21 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.100785:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df205 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25b5 expref: 21 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.100804:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ec94636f00) 00010000:00010000:2.0:1787692441.100809:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.100843:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.100850:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.100874:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692441.100918:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec886a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+21:2361:x1874531108091904:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 167us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692441.100925:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 88 00010000:00010000:1.0:1787692441.102052:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df205 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25b5 expref: 20 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692441.102071:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125899136:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692441.102090:0:8193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.102169:0:8193:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.102185:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787692441.102492:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1787692441.102646:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787692441.102694:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1787692441.102776:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8193:1874531125899264:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787692441.103040:0:8193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692441.103115:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9020cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787692441.103152:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125899264 00000100:00100000:2.0:1787692441.103159:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125899264 00000100:00100000:2.0:1787692441.103239:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787692441.103249:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8193:x1874531125899264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787692441.103497:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8193:x1874531125899264:12345-0@lo:1000:mdt00_003.0 Request processed in 249us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692441.103505:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787692441.103671:0:8193:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1787692441.103678:0:8193:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1787692441.103694:0:8193:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92ecaf686300, transno 4294967321 00000100:00100000:0.0:1787692441.103715:0:8193:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff92ecaf687800 x1874531125898496/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787692456 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692441.103726:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8193:1874531125899264:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1787692441.104194:0:8193:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787692441.104525:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8193:1874531125899392:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787692441.104566:0:8193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692441.104898:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90326000 going to sleep for 11 seconds 00000100:00100000:2.0:1787692441.104992:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125899392 00000100:00100000:2.0:1787692441.104998:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125899392 00000100:00100000:2.0:1787692441.105030:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787692441.105038:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8193:x1874531125899392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787692441.105208:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8193:x1874531125899392:12345-0@lo:1000:mdt00_003.0 Request processed in 170us (640us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787692441.105215:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787692441.105309:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8193:1874531125899392:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787692441.105342:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105353:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105361:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105373:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692441.105378:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105386:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105401:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ec94636f00) 00010000:00010000:0.0:1787692441.105404:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787692441.105409:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105415:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0400/0x5d8b8560a09df252 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105443:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105450:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df195 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105455:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df195 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105461:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692441.105463:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df195 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105469:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df195 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105487:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692441.105489:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787692441.105495:0:8193:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df19c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2599 expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105506:0:8193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df19c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2599 expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105516:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df19c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2599 expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.105542:0:8193:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df19c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2599 expref: 23 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692441.105553:0:8193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf686300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125899520:192.168.206.27@tcp:105: 00000100:00100000:0.0:1787692441.105619:0:8193:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90213b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787692441.109022:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692441.109093:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108092032 00000100:00100000:0.0:1787692441.109102:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108092032 00000100:00100000:0.0:1787692441.109155:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:0.0:1787692441.109165:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+24:11629:x1874531108092032:12345-192.168.206.27@tcp:49:lfs.0 00000100:00100000:0.0:1787692441.109285:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+24:11629:x1874531108092032:12345-192.168.206.27@tcp:49:lfs.0 Request processed in 120us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692441.109302:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 61 00000100:00100000:2.0:1787692441.110144:0:8193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf686300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8193:1874531125899520:192.168.206.27@tcp:105: 00010000:00010000:2.0:1787692441.110169:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df195 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110178:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2200/0x5d8b8560a09df195 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110205:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df259 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110217:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110227:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110251:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110267:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df259 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110274:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df259 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110280:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692441.110284:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df259 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110298:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df259 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110309:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692441.110312:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692441.110315:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df259 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110321:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df259 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110330:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df24b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110335:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df24b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110340:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df24b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110350:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692441.110352:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df24b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110357:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df24b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110365:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692441.110367:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787692441.110370:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df24b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692441.110375:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1c00/0x5d8b8560a09df24b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692441.110584:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+23:11630:x1874531108091776:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 13528us (17523us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787692441.110592:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 230 00000020:00080000:2.0:1787692441.110597:0:8193:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787692441.111396:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787692441.111402:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787692441.111722:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787692441.111735:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787692441.113432:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692441.113553:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108092288 00000100:00100000:0.0:1787692441.113562:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108092288 00000100:00100000:0.0:1787692441.113616:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 62 00000100:00100000:0.0:1787692441.113625:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83550050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+23:11630:x1874531108092288:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787692441.114246:0:5834:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787692441.115629:0:5834:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1787692441.115693:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df260 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.115709:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.115721:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.115730:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df260 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.115737:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df260 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.115743:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df260 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.115766:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787692441.116338:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692441.116345:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df260 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.116352:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0e00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692441.116356:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df260 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.116363:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df260 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.116387:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff92ec832f4c00) 00010000:00010000:1.0:1787692441.116390:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787692441.116394:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df260 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.116400:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df260 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692441.116416:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692441.116418:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692441.116420:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692441.116904:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83550050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+25:11630:x1874531108092288:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 3273us (3473us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1787692441.116914:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 62 00000020:00080000:0.0:1787692441.116920:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787692441.120017:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692441.120226:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108092544 00000100:00100000:3.0:1787692441.120234:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108092544 00000100:00100000:3.0:1787692441.120409:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 231 00000100:00100000:3.0:1787692441.120420:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+25:11629:x1874531108092544:12345-192.168.206.27@tcp:58:lfs.0 00000040:00080000:3.0:1787692441.120638:0:8461:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787692441.120724:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+25:11629:x1874531108092544:12345-192.168.206.27@tcp:58:lfs.0 Request processed in 305us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692441.120743:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 231 00000100:00100000:1.0:1787692441.145151:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692441.145800:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108092672 00000100:00100000:3.0:1787692441.145810:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108092672 00000100:00100000:3.0:1787692441.145914:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 232 00000100:00100000:3.0:1787692441.145925:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+25:11632:x1874531108092672:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:3.0:1787692441.145947:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692441.145966:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09df267 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b25d1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.146025:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df26e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.146038:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df26e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.146049:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df26e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.146063:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df275 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.146070:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.146077:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.146559:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df27c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.146581:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2592 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.146590:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df27c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.146626:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2592 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.146641:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2592 expref: 26 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692441.146655:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecb511f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125899648:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692441.146724:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb4b8b300 going to sleep for 11 seconds 00000100:00100000:1.0:1787692441.149006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692441.149199:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108092928 00000100:00100000:2.0:1787692441.149208:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108092928 00000100:00100000:2.0:1787692441.149266:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:2.0:1787692441.149276:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+27:6060:x1874531108092928:12345-192.168.206.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787692441.149518:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+28:6060:x1874531108092928:12345-192.168.206.27@tcp:35:ldlm_bl.0 Request processed in 242us (518us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787692441.149525:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 63 00000100:00100000:3.0:1787692441.151338:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecb511f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1874531125899648:192.168.206.27@tcp:104: 00010000:00010000:3.0:1787692441.151367:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df27c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692441.151614:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692441.151688:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108093056 00000100:00100000:3.0:1787692441.151694:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108093056 00010000:00010000:3.0:1787692441.151725:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2592 expref: 28 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692441.151761:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 89 00000100:00100000:3.0:1787692441.151771:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf686680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+28:2362:x1874531108093056:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692441.151784:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692441.151803:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2592 expref: 28 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.151848:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2592 expref: 28 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.151878:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df187 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2592 expref: 28 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.151895:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:3.0:1787692441.151900:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df27c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.151909:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.151916:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df27c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692441.151937:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692441.151992:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf686680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:067f46f5-4779-40e6-b53d-5b3e89751501+27:2362:x1874531108093056:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 222us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692441.152000:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 89 00010000:00010000:0.0:1787692441.152057:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152064:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692441.152104:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1787692441.152109:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692441.152125:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152137:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152146:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df26e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152152:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df26e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152159:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df26e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152163:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692441.152168:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df26e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152174:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df26e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152182:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:0.0:1787692441.152185:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692441.152197:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df26e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152203:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df26e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152214:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df275 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152221:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df275 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152227:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152231:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692441.152235:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df275 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152241:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df275 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152248:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff92ec9459a300) 00010000:00010000:0.0:1787692441.152250:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692441.152253:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df275 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152271:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df275 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152313:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09df267 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25d1 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152337:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df27c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25d1 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692441.152345:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692441.152347:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692441.152350:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35b200, rc 0) 00000100:00100000:0.0:1787692441.152374:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+26:11632:x1874531108092672:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 6452us (7235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692441.152381:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 232 00000100:00100000:2.0:1787692441.409843:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125899904:0@lo:400:kworker.0 00000100:00100000:0.0:1787692441.409844:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125900032:0@lo:400:kworker.0 00000100:00100000:3.0:1787692441.410004:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125899776:0@lo:400:kworker.0 00000100:00100000:2.0:1787692441.410984:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692441.411047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692441.411071:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125900160:0@lo:400:kworker.0 00000100:00100000:0.0:1787692441.411091:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125899904 00000100:00100000:0.0:1787692441.411098:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125899904 00000100:00100000:2.0:1787692441.411100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692441.411127:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125900032 00000100:00100000:2.0:1787692441.411130:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125900032 00000100:00100000:0.0:1787692441.411136:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125900160 00000100:00100000:0.0:1787692441.411138:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125900160 00000100:00100000:0.0:1787692441.411158:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1787692441.411228:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125899904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692441.411278:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125899904:12345-0@lo:400:kworker.0 Request processed in 112us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692441.412121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692441.413867:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787692441.413889:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125900160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692441.413972:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125900160:12345-0@lo:400:kworker.0 Request processed in 94us (2871us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692441.413979:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787692441.414004:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787692441.414010:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125900032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692441.414045:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125900032:12345-0@lo:400:kworker.0 Request processed in 36us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692441.414050:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787692441.414093:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125899904:0@lo:400:kworker.0 00000100:00100000:3.0:1787692441.414237:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125900160:0@lo:400:kworker.0 00000100:00100000:2.0:1787692441.420229:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125899776 00000100:00100000:2.0:1787692441.420244:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125899776 00000100:00100000:2.0:1787692441.420323:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787692441.420334:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3306:x1874531125899776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692441.420426:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3306:x1874531125899776:12345-0@lo:400:kworker.0 Request processed in 94us (8307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692441.420433:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787692441.420491:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125900032:0@lo:400:kworker.0 00000100:00100000:2.0:1787692441.420525:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125899776:0@lo:400:kworker.0 00000100:00080000:1.0:1787692441.422527:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692441.429883:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000040:00080000:0.0:1787692441.859168:0:12505:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787692441.859181:0:12505:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787692441.859223:0:12505:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787692441.859229:0:12505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787692441.922855:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125900288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787692441.922927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692441.922995:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125900288 00000100:00100000:2.0:1787692441.923001:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125900288 00000100:00100000:2.0:1787692441.923046:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787692441.923055:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874531125900288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787692441.923077:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787692441.923116:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874531125900288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692441.923123:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787692441.923167:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125900288:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1787692442.113120:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787692442.113127:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787692442.113174:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787692442.113180:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787692442.113376:0:11674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874531125900416:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787692442.113570:0:11674:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec876af540 going to sleep for 11 seconds 00010000:00010000:3.0:1787692442.117144:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692442.117474:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692442.117699:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108093184 00000100:00100000:3.0:1787692442.117708:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108093184 00000100:00100000:3.0:1787692442.117785:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 233 00000100:00100000:3.0:1787692442.117796:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+27:11644:x1874531108093184:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787692442.117859:0:8461:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787692442.117963:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+27:11644:x1874531108093184:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 169us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692442.117973:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 233 00000100:00100000:1.0:1787692442.121077:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692442.121301:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108093440 00000100:00100000:3.0:1787692442.121311:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108093440 00000100:00100000:3.0:1787692442.121368:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 234 00000100:00100000:3.0:1787692442.121379:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+27:11644:x1874531108093440:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787692442.121398:0:8193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692442.121419:0:8193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09df283 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b25d8 expref: -99 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692442.121519:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df28a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692442.121533:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df28a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692442.121545:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df28a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692442.121556:0:8193:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787692442.121672:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35ae00/0x5d8b8560a09df283 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25d8 expref: 30 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692442.121691:0:8193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df28a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25d8 expref: 29 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692442.121722:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:3.0:1787692442.121725:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787692442.121729:0:8193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35a800, rc 0) 00000100:00100000:3.0:1787692442.121945:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+29:11644:x1874531108093440:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 568us (877us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787692442.121952:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 234 00000100:00100000:2.0:1787692442.122225:0:11674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11674:1874531125900416:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787692442.126660:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692442.126749:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692442.127158:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108093568 00000100:00100000:2.0:1787692442.127168:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108093568 00000100:00100000:2.0:1787692442.127235:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:2.0:1787692442.127245:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5331f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+28:2362:x1874531108093568:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692442.127268:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692442.127301:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df28a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25d8 expref: 28 pid: 8193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692442.127319:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:2.0:1787692442.127324:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692442.127375:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5331f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:067f46f5-4779-40e6-b53d-5b3e89751501+27:2362:x1874531108093568:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 132us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692442.127382:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:0.0:1787692442.127556:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108093824 00000100:00100000:0.0:1787692442.127561:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108093824 00000100:00100000:0.0:1787692442.127599:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 235 00000100:00100000:0.0:1787692442.127607:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+27:11644:x1874531108093824:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787692442.127669:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df298 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692442.127682:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692442.127691:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692442.128426:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df298 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692442.128435:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df298 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692442.128442:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692442.128448:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692442.128452:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df298 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692442.128484:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df298 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692442.128494:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692442.128497:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787692442.128501:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df298 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692442.128506:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df298 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692442.128639:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf937800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+28:11644:x1874531108093824:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 1030us (1886us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1787692442.128647:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 235 00000040:00080000:3.0:1787692442.128982:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787692442.128986:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787692442.129592:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787692442.129601:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787692442.133615:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692442.133712:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108094080 00000100:00100000:2.0:1787692442.133721:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108094080 00000100:00100000:2.0:1787692442.133840:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:2.0:1787692442.133851:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+28:11644:x1874531108094080:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787692442.134084:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf936a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+29:11644:x1874531108094080:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 234us (476us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787692442.134091:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 64 00000100:00100000:3.0:1787692442.945009:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125900544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787692442.945083:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692442.947332:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125900544 00000100:00100000:2.0:1787692442.947344:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125900544 00000100:00100000:2.0:1787692442.947402:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787692442.947410:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874531125900544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787692442.947439:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692442.947491:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1874531125900544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (2409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692442.947498:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1787692442.947556:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787692442.947618:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125900544:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787692442.973057:0:12413:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1787692442.973081:0:12413:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:0.0:1787692443.141477:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787692443.863753:0:12559:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787692443.863767:0:12559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787692443.863853:0:12559:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787692443.863861:0:12559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787692444.137073:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692444.137185:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108094336 00000100:00100000:1.0:1787692444.137209:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108094336 00000100:00100000:1.0:1787692444.137325:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 236 00000100:00100000:1.0:1787692444.137340:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+29:11664:x1874531108094336:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692444.137373:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692444.137400:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df29f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b25df expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692444.137534:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09df2a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692444.137553:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09df2a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692444.137568:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09df2a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692444.137580:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787692444.137765:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df29f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25df expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692444.137789:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09df2a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25df expref: 31 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692444.137798:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:1.0:1787692444.137801:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787692444.137805:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165a00, rc 0) 00000100:00100000:1.0:1787692444.137933:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+31:11664:x1874531108094336:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 597us (876us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1787692444.137942:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 236 00000100:00080000:0.0:1787692444.139031:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692444.152317:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692444.152574:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108094464 00000100:00100000:0.0:1787692444.152590:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108094464 00000100:00100000:0.0:1787692444.152666:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 237 00000100:00100000:0.0:1787692444.152679:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+31:11664:x1874531108094464:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:0.0:1787692444.152779:0:8193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df2b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692444.152801:0:8193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692444.152850:0:8193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692444.152903:0:8193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df2b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692444.152911:0:8193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df2b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692444.152919:0:8193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692444.152925:0:8193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0000 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692444.152930:0:8193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df2b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692444.152939:0:8193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df2b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692444.152956:0:8193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692444.152959:0:8193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787692444.152964:0:8193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df2b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692444.152971:0:8193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0000/0x5d8b8560a09df2b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8193 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692444.153062:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:067f46f5-4779-40e6-b53d-5b3e89751501+31:11664:x1874531108094464:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 385us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692444.153070:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 237 00010000:00010000:0.0:1787692444.168632:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692444.266472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692444.266945:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108094592 00000100:00100000:3.0:1787692444.266959:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108094592 00000100:00080000:0.0:1787692444.267118:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787692444.267191:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 71 00000100:00100000:2.0:1787692444.267216:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2364:x1874531108094592:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:2.0:1787692444.267245:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692444.267344:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df2bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b25e6 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787692444.267383:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8e0598, atime: 0x6a8e0597, ctime: 0x6a8e0598, blocks: 0xb 00010000:00010000:2.0:1787692444.267480:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1787692444.267487:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692444.267499:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df2bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25e6 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692444.267555:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df2bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25e6 expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692444.267573:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3200, rc 0) 00000100:00100000:2.0:1787692444.267805:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf936d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+8:2364:x1874531108094592:12345-192.168.206.27@tcp:101:cat.0 Request processed in 602us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692444.267849:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 71 00000100:00100000:3.0:1787692444.273544:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692444.275462:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108094720 00000100:00100000:2.0:1787692444.275482:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108094720 00002000:00100000:2.0:1787692444.275566:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff92ecb511d180 x1874531108094720/t0(0) o3->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:435/0 lens 488/0 e 0 to 0 dl 1787692455 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787692444.275580:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecb511d180 with x1874531108094720 ext(0->4095) 00002000:00010000:2.0:1787692444.275588:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecb511d180 00000100:00100000:2.0:1787692444.275749:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:2.0:1787692444.275762:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:067f46f5-4779-40e6-b53d-5b3e89751501+8:2363:x1874531108094720:12345-192.168.206.27@tcp:3:cat.0 00000100:00100000:2.0:1787692444.276108:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:067f46f5-4779-40e6-b53d-5b3e89751501+8:2363:x1874531108094720:12345-192.168.206.27@tcp:3:cat.0 Request processed in 347us (2577us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1787692444.276117:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00002000:00100000:2.0:1787692444.276125:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff92ecb511d180 x1874531108094720/t0(0) o3->067f46f5-4779-40e6-b53d-5b3e89751501@192.168.206.27@tcp:435/0 lens 488/4536 e 0 to 0 dl 1787692455 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787692444.276133:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff92ecb511d180 with x1874531108094720 ext(0->4095) 00002000:00010000:2.0:1787692444.276138:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff92ecb511d180 00010000:00010000:1.0:1787692445.202120:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692445.856803:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692445.856881:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692445.856910:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692445.857203:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692445.857489:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108094848 00000100:00100000:2.0:1787692445.857519:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108094848 00000100:00100000:2.0:1787692445.857578:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 290 00000100:00100000:2.0:1787692445.857590:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:2363:x1874531108094848:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692445.857682:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+13:2363:x1874531108094848:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 94us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692445.857692:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 290 00000100:00100000:2.0:1787692445.857735:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108095232 00000100:00100000:2.0:1787692445.857739:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108095232 00000100:00100000:2.0:1787692445.857766:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108095104 00000100:00100000:2.0:1787692445.857769:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108095104 00000100:00100000:2.0:1787692445.857806:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:2.0:1787692445.857852:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+8:2363:x1874531108095232:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692445.857883:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+8:2363:x1874531108095232:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 70us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692445.857889:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:2.0:1787692445.857900:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00100000:2.0:1787692445.857906:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2363:x1874531108095104:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692445.857942:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2363:x1874531108095104:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 35us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692445.857947:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00080000:2.0:1787692445.858076:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787692445.858704:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692445.858909:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108094976 00000100:00100000:2.0:1787692445.858975:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108094976 00000100:00100000:2.0:1787692445.859058:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108095360 00000100:00100000:2.0:1787692445.859062:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108095360 00000100:00100000:3.0:1787692445.861771:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 145 00000100:00100000:3.0:1787692445.861809:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+31:2363:x1874531108094976:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692445.862056:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:067f46f5-4779-40e6-b53d-5b3e89751501+31:2363:x1874531108094976:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 268us (5267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692445.862084:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 145 00000100:00100000:3.0:1787692445.862115:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 146 00000100:00100000:3.0:1787692445.862123:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb511c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2363:x1874531108095360:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692445.862156:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb511c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:749d9e33-d584-4e2f-a596-9a00b88adda5+5:2363:x1874531108095360:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 34us (3455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692445.862172:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 146 00000100:00080000:2.0:1787692445.862319:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1787692446.111411:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:3.0:1787692446.111437:0:5853:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff92ec909056c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787692446.111442:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ec904fb800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff92ec998db480 00000020:00080000:3.0:1787692446.111446:0:5853:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff92ec904fbf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92ecb4fee400 00000001:00080000:3.0:1787692446.111547:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787692446.111555:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1787692446.111587:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787692446.111857:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1787692446.141183:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1787692446.141216:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:1.0:1787692446.209019:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692446.529293:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125900928:0@lo:400:kworker.0 00000100:00100000:1.0:1787692446.529391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692446.529585:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125900800:0@lo:400:kworker.0 00000100:00100000:3.0:1787692446.529627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692446.529657:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787692446.529663:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125900672:0@lo:400:kworker.0 00000100:00100000:3.0:1787692446.529701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692446.529748:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125900928 00000100:00100000:3.0:1787692446.529758:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125900928 00000100:00100000:3.0:1787692446.529859:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125900800 00000100:00100000:3.0:1787692446.529863:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125900800 00000100:00100000:3.0:1787692446.529892:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787692446.529902:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125900928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692446.530069:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787692446.530080:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125900800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692446.530126:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf679500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125900800:12345-0@lo:400:kworker.0 Request processed in 48us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692446.530135:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1787692446.530162:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692446.530205:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125900800:0@lo:400:kworker.0 00000100:00100000:0.0:1787692446.530514:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125900672 00000100:00100000:0.0:1787692446.530519:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125900672 00000100:00100000:0.0:1787692446.530553:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787692446.530560:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125900672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692446.530598:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125900672:12345-0@lo:400:kworker.0 Request processed in 39us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692446.530604:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1787692446.530640:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125900672:0@lo:400:kworker.0 00000100:00100000:0.0:1787692446.530676:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125901056:0@lo:400:kworker.0 00000100:00100000:0.0:1787692446.530711:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692446.530755:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125901056 00000100:00100000:0.0:1787692446.530759:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125901056 00000100:00100000:0.0:1787692446.530797:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787692446.530804:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125901056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692446.530877:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125901056:12345-0@lo:400:kworker.0 Request processed in 74us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692446.530884:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1787692446.530929:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787692446.530947:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787692446.530954:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1787692446.530974:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92ecaf1c5f80, transno 4294967310 00000100:00100000:0.0:1787692446.530999:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125901056:0@lo:400:kworker.0 00000100:00100000:3.0:1787692446.532396:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf934380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125900928:12345-0@lo:400:kworker.0 Request processed in 2484us (2994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692446.532410:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787692446.532624:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125900928:0@lo:400:kworker.0 00000100:00100000:0.0:1787692446.532832:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125901184:0@lo:400:kworker.0 00000100:00100000:0.0:1787692446.532893:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692446.532972:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125901184 00000100:00100000:1.0:1787692446.532988:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125901184 00000100:00100000:1.0:1787692446.533053:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787692446.533063:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125901184:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787692446.533269:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692446.533294:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125901312:0@lo:400:kworker.0 00000100:00100000:3.0:1787692446.533331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692446.533723:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125901184:12345-0@lo:400:kworker.0 Request processed in 660us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692446.533733:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787692446.533763:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125901312 00000100:00100000:1.0:1787692446.533768:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125901312 00000100:00100000:1.0:1787692446.533844:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787692446.533853:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125901312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692446.533914:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf678000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125901312:12345-0@lo:400:kworker.0 Request processed in 62us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692446.533920:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787692446.533955:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787692446.533961:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92ecaf687800, transno 4294967322 00000004:00080000:1.0:1787692446.533973:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787692446.534011:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125901312:0@lo:400:kworker.0 00000100:00080000:3.0:1787692446.534671:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787692446.534773:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125901184:0@lo:400:kworker.0 00000100:00100000:3.0:1787692447.041988:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787692447.042019:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125901440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692447.042114:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692447.042203:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125901440 00000100:00100000:3.0:1787692447.042212:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125901440 00000100:00100000:3.0:1787692447.042296:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787692447.042307:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125901440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787692447.042354:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692447.042619:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf678e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125901440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 313us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692447.042629:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787692447.042685:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf679180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125901440:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787692447.233046:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692448.071313:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125901568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787692448.071418:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692448.071509:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125901568 00000100:00100000:2.0:1787692448.071518:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125901568 00000100:00100000:2.0:1787692448.071581:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787692448.071591:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125901568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787692448.071635:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692448.071686:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125901568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692448.071694:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787692448.071972:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787692448.072014:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125901568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787692448.257065:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692449.286437:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692450.097943:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692450.098064:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108095488 00000100:00100000:0.0:1787692450.098074:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108095488 00000100:00100000:0.0:1787692450.098146:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 238 00000100:00100000:0.0:1787692450.098156:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+18:11318:x1874531108095488:12345-192.168.206.27@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787692450.098265:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+18:11318:x1874531108095488:12345-192.168.206.27@tcp:60:lhsmtool_posix.0 Request processed in 109us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692450.098272:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 238 00000100:00080000:2.0:1787692450.098440:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692450.115196:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692450.115321:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108095744 00000100:00100000:2.0:1787692450.115332:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108095744 00000100:00100000:2.0:1787692450.115393:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 65 00000100:00100000:2.0:1787692450.115403:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+18:11318:x1874531108095744:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787692450.115984:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf934000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+19:11318:x1874531108095744:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 580us (795us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787692450.115994:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 65 00000100:00100000:1.0:1787692450.259592:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692450.259704:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108095872 00000100:00100000:3.0:1787692450.259721:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108095872 00000100:00080000:2.0:1787692450.259859:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692450.259898:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 239 00000100:00100000:0.0:1787692450.259933:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:749d9e33-d584-4e2f-a596-9a00b88adda5+5:12116:x1874531108095872:12345-192.168.206.27@tcp:101:lsof.0 00010000:00010000:0.0:1787692450.259958:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692450.259982:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df2c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b25ed expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692450.260048:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df2c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692450.260076:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692450.260092:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692450.260289:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787692450.260294:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692450.260379:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df2c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692450.260405:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0e00/0x5d8b8560a09df2c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ed expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692450.260423:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df2c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ed expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692450.260431:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636c00) 00010000:00010000:0.0:1787692450.260434:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787692450.260439:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0c00, rc 0) 00000100:00100000:0.0:1787692450.260522:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:749d9e33-d584-4e2f-a596-9a00b88adda5+6:12116:x1874531108095872:12345-192.168.206.27@tcp:101:lsof.0 Request processed in 612us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692450.260530:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 239 00010000:00010000:1.0:1787692450.305046:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692450.975755:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692450.975856:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692450.975887:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692450.975921:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692450.975951:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692450.975986:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108096512 00000100:00100000:3.0:1787692450.976013:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108096512 00000100:00100000:1.0:1787692450.976216:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108096128 00000100:00100000:1.0:1787692450.976221:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108096128 00000100:00100000:1.0:1787692450.976304:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 150 00000100:00100000:1.0:1787692450.976318:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+19:2363:x1874531108096128:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692450.976331:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 151 00000100:00100000:3.0:1787692450.976371:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+6:2363:x1874531108096512:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692450.976432:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:067f46f5-4779-40e6-b53d-5b3e89751501+19:2363:x1874531108096128:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 116us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692450.976442:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 150 00000100:00100000:3.0:1787692450.976674:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+6:2363:x1874531108096512:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 327us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692450.976685:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 151 00000100:00100000:2.0:1787692450.977174:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108096000 00000100:00100000:2.0:1787692450.977184:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108096000 00000100:00100000:2.0:1787692450.977312:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 292 00000100:00100000:2.0:1787692450.977322:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2363:x1874531108096000:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692450.977377:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0696784b-1191-4b0f-b755-3a72c69e021b+13:2363:x1874531108096000:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 57us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692450.977399:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 292 00000100:00100000:0.0:1787692450.979569:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108096256 00000100:00100000:0.0:1787692450.979586:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108096256 00000100:00100000:0.0:1787692450.979739:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108096384 00000100:00100000:0.0:1787692450.979744:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108096384 00000100:00100000:0.0:1787692450.979785:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 89 00000100:00100000:0.0:1787692450.979796:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2363:x1874531108096256:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692450.980104:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 90 00000100:00100000:1.0:1787692450.980116:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2363:x1874531108096384:12345-192.168.206.27@tcp:400:kworker.0 00000100:00080000:2.0:1787692450.980689:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787692450.980695:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787692450.981533:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:067f46f5-4779-40e6-b53d-5b3e89751501+7:2363:x1874531108096384:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 1415us (5575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692450.981546:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 90 00000100:00100000:0.0:1787692450.982891:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2363:x1874531108096256:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 3084us (7068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692450.982905:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 89 00000001:00080000:0.0:1787692451.183574:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787692451.183594:0:5853:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787692451.183700:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787692451.183714:0:5864:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1787692451.329031:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787692451.329345:0:11674:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787692451.329350:0:11674:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787692451.329782:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1787692451.329788:0:11674:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787692451.649096:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125901696:0@lo:400:kworker.0 00000100:00100000:2.0:1787692451.649102:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125902080:0@lo:400:kworker.0 00000100:00100000:3.0:1787692451.649190:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125901952:0@lo:400:kworker.0 00000100:00100000:1.0:1787692451.649193:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125901824:0@lo:400:kworker.0 00000100:00100000:1.0:1787692451.661225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692451.661414:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125902336:0@lo:400:kworker.0 00000100:00100000:1.0:1787692451.661462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692451.661586:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125901824 00000100:00100000:1.0:1787692451.661947:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125901824 00000100:00100000:1.0:1787692451.662014:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787692451.662024:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125901824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692451.662084:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125901824:12345-0@lo:400:kworker.0 Request processed in 63us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692451.662092:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787692451.662157:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125901824:0@lo:400:kworker.0 00000100:00100000:1.0:1787692451.662196:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125902336 00000100:00100000:1.0:1787692451.662200:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125902336 00000100:00100000:1.0:1787692451.662255:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787692451.662262:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125902336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692451.662300:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125902336:12345-0@lo:400:kworker.0 Request processed in 39us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692451.662307:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787692451.662335:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125902336:0@lo:400:kworker.0 00000100:00080000:1.0:1787692451.662359:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787692451.662598:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692451.662635:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125902208:0@lo:400:kworker.0 00000100:00100000:0.0:1787692451.662746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692451.662774:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125902208 00000100:00100000:0.0:1787692451.662778:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125902208 00000100:00100000:0.0:1787692451.662965:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787692451.662973:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125902208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692451.664985:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125902208:12345-0@lo:400:kworker.0 Request processed in 2003us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692451.664997:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1787692451.665043:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692451.665084:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125902208:0@lo:400:kworker.0 00000100:00100000:2.0:1787692451.667002:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692451.667340:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125902080 00000100:00100000:0.0:1787692451.667350:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125902080 00000100:00100000:0.0:1787692451.667417:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787692451.667427:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125902080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692451.667485:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125902080:12345-0@lo:400:kworker.0 Request processed in 60us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692451.667509:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787692451.667759:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125901696 00000100:00100000:1.0:1787692451.667765:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125901696 00000100:00100000:1.0:1787692451.667805:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787692451.667837:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125901696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692451.667878:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3304:x1874531125901696:12345-0@lo:400:kworker.0 Request processed in 66us (5281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692451.667892:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787692451.668771:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787692451.669017:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787692451.669057:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125902080:0@lo:400:kworker.0 00000100:00100000:1.0:1787692451.669079:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125901952 00000100:00100000:1.0:1787692451.669144:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125901952 00000100:00100000:1.0:1787692451.669270:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787692451.669277:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125901696:0@lo:400:kworker.0 00000100:00100000:1.0:1787692451.669283:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125901952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692451.669451:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125901952:12345-0@lo:400:kworker.0 Request processed in 173us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692451.669458:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787692451.669528:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125901952:0@lo:400:kworker.0 00000100:00080000:2.0:1787692451.669629:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692452.161207:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787692452.163607:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecc5661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125902464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787692452.164609:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692452.164981:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125902464 00000100:00100000:2.0:1787692452.164993:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125902464 00000100:00100000:2.0:1787692452.165069:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787692452.165081:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125902464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787692452.165131:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692452.165468:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125902464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 388us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692452.165477:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787692452.165663:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecc5661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125902464:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787692452.353030:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787692453.087644:0:12763:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 17:14:11 (1787692451) 00000100:00100000:2.0:1787692453.185036:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787692453.185064:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecafba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125902592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787692453.185156:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692453.185246:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125902592 00000100:00100000:2.0:1787692453.185253:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125902592 00000100:00100000:2.0:1787692453.185311:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787692453.185321:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125902592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787692453.185363:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692453.185408:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125902592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692453.185426:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1787692453.185447:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787692453.185490:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecafba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125902592:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787692453.378316:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692454.404859:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692455.425480:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692456.096332:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692456.096382:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692456.096426:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692456.096463:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692456.096482:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108096896 00000100:00100000:2.0:1787692456.096498:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108096896 00000100:00100000:1.0:1787692456.096506:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692456.096549:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108097152 00000100:00100000:1.0:1787692456.096558:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108097152 00000100:00100000:2.0:1787692456.096580:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108097024 00000100:00100000:2.0:1787692456.096586:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108097024 00000100:00100000:1.0:1787692456.096619:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108096768 00000100:00100000:1.0:1787692456.096625:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108096768 00000100:00100000:2.0:1787692456.096642:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 93 00000100:00100000:2.0:1787692456.096655:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca6499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108096896:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692456.096670:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 155 00000100:00100000:1.0:1787692456.096685:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+6:2361:x1874531108097152:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692456.096738:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca6499c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+5:2361:x1874531108096896:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 84us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692456.096748:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 93 00000100:00100000:1.0:1787692456.096768:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:749d9e33-d584-4e2f-a596-9a00b88adda5+6:2361:x1874531108097152:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 83us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692456.096777:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 94 00000100:00100000:1.0:1787692456.096791:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 155 00000100:00100000:2.0:1787692456.096799:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108097024:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692456.096878:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:2361:x1874531108097024:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 87us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692456.096886:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 156 00000100:00100000:2.0:1787692456.096893:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 94 00000100:00100000:1.0:1787692456.096902:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+18:2361:x1874531108096768:12345-192.168.206.27@tcp:400:kworker.0 00000100:00080000:2.0:1787692456.096919:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787692456.096926:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787692456.096932:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787692456.096972:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:067f46f5-4779-40e6-b53d-5b3e89751501+18:2361:x1874531108096768:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 74us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692456.096982:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 156 00000100:00100000:3.0:1787692456.097492:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108096640 00000100:00100000:3.0:1787692456.097499:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108096640 00000100:00100000:3.0:1787692456.097548:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 294 00000100:00100000:3.0:1787692456.097556:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2361:x1874531108096640:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692456.097600:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0696784b-1191-4b0f-b755-3a72c69e021b+13:2361:x1874531108096640:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 45us (1285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692456.097607:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 294 00010000:00010000:0.0:1787692456.449319:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692456.771504:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125902848:0@lo:400:kworker.0 00000100:00100000:2.0:1787692456.771571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692456.771640:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125903360:0@lo:400:kworker.0 00000100:00100000:2.0:1787692456.771669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692456.771698:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787692456.771704:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125902720:0@lo:400:kworker.0 00000100:00100000:2.0:1787692456.771731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692456.771750:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125903232:0@lo:400:kworker.0 00000100:00100000:2.0:1787692456.771771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692456.771806:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125902848 00000100:00100000:2.0:1787692456.771830:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125902848 00000100:00100000:2.0:1787692456.771883:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125903232 00000100:00100000:2.0:1787692456.771886:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125903232 00000100:00100000:2.0:1787692456.771915:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787692456.771923:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125902848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692456.771971:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874531125902848:12345-0@lo:400:kworker.0 Request processed in 48us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692456.771978:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787692456.771993:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787692456.772000:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecae9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125903232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692456.772027:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecae9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125903232:12345-0@lo:400:kworker.0 Request processed in 27us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692456.772032:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787692456.772052:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125903360 00000100:00100000:2.0:1787692456.772055:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125903360 00000100:00100000:2.0:1787692456.772082:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787692456.772089:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecafba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125903360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692456.772117:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecafba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125903360:12345-0@lo:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692456.772132:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1787692456.772149:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787692456.772153:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692456.772184:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125903232:0@lo:400:kworker.0 00000100:00100000:2.0:1787692456.772215:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874531125902848:0@lo:400:kworker.0 00000100:00100000:2.0:1787692456.772225:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125903360:0@lo:400:kworker.0 00000100:00100000:3.0:1787692456.772641:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125902976:0@lo:400:kworker.0 00000100:00100000:3.0:1787692456.772686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692456.772717:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692456.772724:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec91f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125903104:0@lo:400:kworker.0 00000100:00100000:3.0:1787692456.772747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692456.772896:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125902976 00000100:00100000:1.0:1787692456.772902:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125902976 00000100:00100000:1.0:1787692456.772946:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787692456.772954:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125902976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692456.772992:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125902976:12345-0@lo:400:kworker.0 Request processed in 38us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692456.772999:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1787692456.773106:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692456.773128:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125902976:0@lo:400:kworker.0 00000100:00100000:0.0:1787692456.773228:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125902720 00000100:00100000:0.0:1787692456.773232:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125902720 00000100:00100000:0.0:1787692456.773276:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787692456.773285:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125902720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692456.773332:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125902720:12345-0@lo:400:kworker.0 Request processed in 49us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692456.773338:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1787692456.773430:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125903104 00000100:00100000:2.0:1787692456.773435:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125903104 00000100:00100000:2.0:1787692456.773478:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787692456.773486:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125903104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692456.773521:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5661500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125903104:12345-0@lo:400:kworker.0 Request processed in 38us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692456.773527:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1787692456.773642:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787692456.773701:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec91f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125903104:0@lo:400:kworker.0 00000100:00100000:1.0:1787692456.774561:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125902720:0@lo:400:kworker.0 00000100:00100000:1.0:1787692457.072158:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692457.072281:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108097408 00000100:00100000:2.0:1787692457.072291:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108097408 00000100:00100000:2.0:1787692457.072347:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 66 00000100:00100000:2.0:1787692457.072358:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+18:12337:x1874531108097408:12345-192.168.206.27@tcp:35:umount.0 00000100:00100000:2.0:1787692457.072908:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+19:12337:x1874531108097408:12345-192.168.206.27@tcp:35:umount.0 Request processed in 550us (758us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787692457.072916:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 66 00000100:00100000:2.0:1787692457.080766:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692457.081037:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108097664 00000100:00100000:3.0:1787692457.081047:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108097664 00000100:00100000:3.0:1787692457.081179:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 67 00000100:00100000:3.0:1787692457.081199:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+19:12337:x1874531108097664:12345-192.168.206.27@tcp:35:umount.0 00000100:00100000:3.0:1787692457.081562:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+20:12337:x1874531108097664:12345-192.168.206.27@tcp:35:umount.0 Request processed in 373us (804us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1787692457.081570:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 67 00000100:00100000:2.0:1787692457.088810:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692457.089385:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108097920 00000100:00100000:0.0:1787692457.089406:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108097920 00000100:00100000:0.0:1787692457.089500:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:0.0:1787692457.089512:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83550c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+20:12337:x1874531108097920:12345-192.168.206.27@tcp:35:umount.0 00000100:00100000:0.0:1787692457.090370:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83550c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:067f46f5-4779-40e6-b53d-5b3e89751501+21:12337:x1874531108097920:12345-192.168.206.27@tcp:35:umount.0 Request processed in 858us (1571us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1787692457.090378:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 68 00000100:00100000:1.0:1787692457.094861:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692457.094952:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108098176 00000100:00100000:3.0:1787692457.094961:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108098176 00000100:00100000:3.0:1787692457.095062:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:3.0:1787692457.095073:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+21:12337:x1874531108098176:12345-192.168.206.27@tcp:35:umount.0 00000100:00100000:3.0:1787692457.095426:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:067f46f5-4779-40e6-b53d-5b3e89751501+22:12337:x1874531108098176:12345-192.168.206.27@tcp:35:umount.0 Request processed in 354us (573us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787692457.095435:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 69 00000100:00100000:2.0:1787692457.102376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692457.102416:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692457.102453:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692457.102871:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108098304 00000100:00100000:0.0:1787692457.102887:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108098304 00000100:00100000:0.0:1787692457.102937:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108098560 00000100:00100000:0.0:1787692457.102939:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108098560 00000100:00100000:0.0:1787692457.102950:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108098432 00000100:00100000:0.0:1787692457.102952:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108098432 00000100:00100000:0.0:1787692457.102966:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:0.0:1787692457.102974:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0696784b-1191-4b0f-b755-3a72c69e021b+15:2364:x1874531108098304:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692457.102987:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692457.103003:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec8b35a000/0x5d8b8560a09de341 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2178 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.103019:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692457.103065:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0696784b-1191-4b0f-b755-3a72c69e021b+14:2364:x1874531108098304:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 91us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692457.103072:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:0.0:1787692457.103088:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:0.0:1787692457.103095:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0696784b-1191-4b0f-b755-3a72c69e021b+13:2364:x1874531108098560:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692457.103102:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692457.103111:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6425800/0x5d8b8560a09de555 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2243 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.103120:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692457.103135:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0696784b-1191-4b0f-b755-3a72c69e021b+12:2364:x1874531108098560:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 41us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692457.103141:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:0.0:1787692457.103151:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:0.0:1787692457.103159:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5331c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0696784b-1191-4b0f-b755-3a72c69e021b+11:2364:x1874531108098432:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692457.103193:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692457.103210:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6425400/0x5d8b8560a09de2a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2140 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.103220:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692457.103236:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5331c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0696784b-1191-4b0f-b755-3a72c69e021b+10:2364:x1874531108098432:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 80us (783us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692457.103242:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:2.0:1787692457.117149:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692457.121330:0:8080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108098944 00000100:00100000:0.0:1787692457.121343:0:8080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108098944 00000100:00100000:1.0:1787692457.125079:0:8080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 72 00000100:00100000:1.0:1787692457.125097:0:8080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+7:2360:x1874531108098944:12345-192.168.206.27@tcp:9:umount.0 00000020:00000080:1.0:1787692457.125130:0:8080:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de87a 00000020:00010000:1.0:1787692457.125138:0:8080:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92ecc561e000: total 0 00000100:00080000:1.0:1787692457.125143:0:8080:0:(import.c:65:import_set_state_nolock()) ffff92ec88171000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787692457.125200:0:8080:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787692457.125478:0:8080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:067f46f5-4779-40e6-b53d-5b3e89751501+5:2360:x1874531108098944:12345-192.168.206.27@tcp:9:umount.0 Request processed in 385us (8338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692457.125487:0:8080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 72 00000020:00010000:3.0:1787692457.125535:0:5820:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92ecc561e000: total 0 00010000:00010000:3.0:1787692457.125566:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92ecc561e000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787692457.125610:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008accfefd/0x5d8b8560a09df2bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25e6 expref: 4 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692457.125641:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09dec1d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2418 expref: 3 pid: 8080 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692457.125654:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92ecc561e000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787692457.125663:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692457.125665:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692457.125677:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692457.130062:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692457.130248:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108099072 00000100:00100000:2.0:1787692457.130258:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108099072 00000100:00100000:2.0:1787692457.130309:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 73 00000100:00100000:2.0:1787692457.130318:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+5:2360:x1874531108099072:12345-192.168.206.27@tcp:9:umount.0 00000020:00000080:2.0:1787692457.130346:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de619 00000100:00080000:2.0:1787692457.130354:0:6681:0:(import.c:65:import_set_state_nolock()) ffff92ec91d85800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787692457.130521:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787692457.130785:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:067f46f5-4779-40e6-b53d-5b3e89751501+2:2360:x1874531108099072:12345-192.168.206.27@tcp:9:umount.0 Request processed in 466us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692457.130793:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 73 00010000:00010000:3.0:1787692457.131059:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692457.135689:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692457.135786:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108100096 00000100:00100000:2.0:1787692457.135796:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108100096 00000100:00100000:2.0:1787692457.135899:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 240 00000100:00100000:2.0:1787692457.135909:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+22:2360:x1874531108100096:12345-192.168.206.27@tcp:39:umount.0 00000020:00000080:2.0:1787692457.135940:0:5832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de2b5 00000020:00010000:2.0:1787692457.135955:0:5832:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92eb86da6800: total 0 00000100:00080000:2.0:1787692457.135960:0:5832:0:(import.c:65:import_set_state_nolock()) ffff92eb86da1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787692457.135979:0:5832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1787692457.136342:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:067f46f5-4779-40e6-b53d-5b3e89751501+21:2360:x1874531108100096:12345-192.168.206.27@tcp:39:umount.0 Request processed in 433us (661us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787692457.136350:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 240 00000020:00010000:0.0:1787692457.136989:0:8438:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92eb86da6800: total 0 00010000:00010000:0.0:1787692457.137035:0:8438:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92eb86da6800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787692457.137075:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:0.0:1787692457.137079:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787692457.137089:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164200/0x5d8b8560a09dec08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2411 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.137106:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692457.137109:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692457.137112:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df27c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25d1 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.137124:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692457.137127:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787692457.137130:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165a00/0x5d8b8560a09df2a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25df expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.137158:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:0.0:1787692457.137161:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692457.137164:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164000/0x5d8b8560a09debde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2403 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.137241:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92ec832f4400) 00010000:00010000:0.0:1787692457.137244:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787692457.137248:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6424600/0x5d8b8560a09de57f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2251 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.137265:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:0.0:1787692457.137267:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787692457.137270:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec80031000/0x5d8b8560a09def7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b250d expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.137279:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:0.0:1787692457.137281:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787692457.137284:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09de8dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b233f expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.137293:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:0.0:1787692457.137295:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787692457.137297:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09dec9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b243b expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.137309:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff92ec832f4a00) 00010000:00010000:0.0:1787692457.137311:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787692457.137323:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09deafe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b23cb expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.137338:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff92ec9dbfa400) 00010000:00010000:0.0:1787692457.137340:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787692457.137343:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164600/0x5d8b8560a09de5ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b226d expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.137356:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff92ec832f4b00) 00010000:00010000:0.0:1787692457.137358:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787692457.137361:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df19c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2599 expref: 10 pid: 8461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.137376:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636c00) 00010000:00010000:0.0:1787692457.137378:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787692457.137382:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09dec7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2434 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.137393:0:8438:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec832f4e00) 00010000:00010000:0.0:1787692457.137395:0:8438:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692457.137399:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92eca6425000/0x5d8b8560a09de59b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2258 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692457.137411:0:8438:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92eb86da6800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787692457.137427:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692457.137429:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692457.137431:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692457.281547:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787692457.281568:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecc5661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125903488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787692457.281629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692457.281807:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125903488 00000100:00100000:2.0:1787692457.281843:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125903488 00000100:00100000:2.0:1787692457.281882:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787692457.281890:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125903488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787692457.282183:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692457.282251:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125903488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 361us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692457.282259:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787692457.282347:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecc5661f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125903488:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787692457.472962:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692458.308543:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787692458.308573:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125903616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787692458.308647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692458.317061:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125903616 00000100:00100000:1.0:1787692458.317077:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125903616 00000100:00100000:1.0:1787692458.317154:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787692458.317163:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125903616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787692458.317210:0:6682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787692458.317287:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125903616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (8640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692458.317294:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787692458.317359:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125903616:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787692458.317452:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1787692458.366276:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 067f46f5-4779-40e6-b53d-5b3e89751501 00000020:00000080:1.0:1787692458.366285:0:6703:0:(genops.c:885:class_export_put()) final put ffff92ec91d81000/067f46f5-4779-40e6-b53d-5b3e89751501 00000020:00000080:0.0:1787692458.366414:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec91d81000/067f46f5-4779-40e6-b53d-5b3e89751501 for lustre-OST0000 00000020:00000080:0.0:1787692458.366484:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ec91d85800 for lustre-OST0000 00010000:00010000:3.0:1787692458.499144:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692458.869091:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692458.869141:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692458.869188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692458.869229:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108100224 00000100:00100000:3.0:1787692458.869238:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108100224 00000100:00100000:3.0:1787692458.869286:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108100480 00000100:00100000:3.0:1787692458.869289:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108100480 00000100:00100000:3.0:1787692458.869301:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108100352 00000100:00100000:3.0:1787692458.869303:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108100352 00000100:00100000:3.0:1787692458.869318:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:3.0:1787692458.869326:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc5661f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0696784b-1191-4b0f-b755-3a72c69e021b+12:2363:x1874531108100224:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692458.869340:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692458.869357:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6425a00/0x5d8b8560a09de387 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b218d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692458.869375:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692458.869506:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc5661f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0696784b-1191-4b0f-b755-3a72c69e021b+11:2363:x1874531108100224:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 179us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692458.869514:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:3.0:1787692458.869532:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:3.0:1787692458.869539:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec886a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0696784b-1191-4b0f-b755-3a72c69e021b+10:2363:x1874531108100480:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692458.869547:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692458.869556:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09de54e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b223c expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692458.869565:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692458.869597:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec886a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0696784b-1191-4b0f-b755-3a72c69e021b+9:2363:x1874531108100480:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 59us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692458.869603:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:3.0:1787692458.869645:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:3.0:1787692458.869652:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0696784b-1191-4b0f-b755-3a72c69e021b+8:2363:x1874531108100352:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692458.869660:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692458.869669:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec8b35a200/0x5d8b8560a09de38e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b21b7 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692458.869676:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692458.869692:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0696784b-1191-4b0f-b755-3a72c69e021b+7:2363:x1874531108100352:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 41us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692458.869697:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:3.0:1787692458.876903:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692458.877012:0:8193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108100736 00000100:00100000:1.0:1787692458.877022:0:8193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108100736 00000100:00100000:1.0:1787692458.877093:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 241 00000100:00100000:1.0:1787692458.877104:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec91f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+6:2360:x1874531108100736:12345-192.168.206.27@tcp:39:umount.0 00000020:00000080:1.0:1787692458.877139:0:8193:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de39c 00000020:00010000:1.0:1787692458.877146:0:8193:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92ec904df000: total 0 00000100:00080000:1.0:1787692458.877150:0:8193:0:(import.c:65:import_set_state_nolock()) ffff92ec904d8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787692458.877185:0:8193:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00080000:2.0:1787692458.877346:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1787692458.877538:0:8439:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92ec904df000: total 0 00010000:00010000:3.0:1787692458.877580:0:8439:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92ec904df000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787692458.877612:0:8439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636c00) 00010000:00010000:3.0:1787692458.877615:0:8439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787692458.877623:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df2c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b25ed expref: 5 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692458.877646:0:8439:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92ec904df000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787692458.877658:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692458.877660:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692458.877662:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692458.877697:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec91f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:749d9e33-d584-4e2f-a596-9a00b88adda5+3:2360:x1874531108100736:12345-192.168.206.27@tcp:39:umount.0 Request processed in 594us (802us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787692458.877705:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 241 00000100:00100000:0.0:1787692458.891582:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692458.891663:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108100992 00000100:00100000:1.0:1787692458.891672:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108100992 00000100:00100000:1.0:1787692458.891718:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 296 00000100:00100000:1.0:1787692458.891726:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+7:2360:x1874531108100992:12345-192.168.206.27@tcp:251:umount.0 00000020:00000080:1.0:1787692458.891784:0:5825:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de292 00000020:00010000:1.0:1787692458.891791:0:5825:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92eb86da2800: total 0 00000100:00080000:1.0:1787692458.891795:0:5825:0:(import.c:65:import_set_state_nolock()) ffff92eb86da6000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787692458.891877:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0696784b-1191-4b0f-b755-3a72c69e021b+3:2360:x1874531108100992:12345-192.168.206.27@tcp:251:umount.0 Request processed in 151us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692458.891885:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 296 00000020:00010000:2.0:1787692458.893091:0:8438:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92eb86da2800: total 0 00010000:00010000:2.0:1787692458.893100:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692458.893145:0:8438:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92eb86da2800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787692458.893187:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec8b35b400/0x5d8b8560a09de348 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b217f expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692458.893212:0:8438:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92eb86da2800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787692458.893223:0:8438:0:(genops.c:885:class_export_put()) final put ffff92eb86da2800/0696784b-1191-4b0f-b755-3a72c69e021b 00010000:00010000:2.0:1787692458.893239:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692458.893241:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692458.893242:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787692458.893324:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb86da2800/0696784b-1191-4b0f-b755-3a72c69e021b for MGS 00000020:00000080:1.0:1787692458.893364:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92eb86da6000 for MGS 00010000:00010000:0.0:1787692459.521045:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692460.549994:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787692460.590084:0:12962:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787692460.606710:0:12962:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787692460.607030:0:12962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.607046:0:12962:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.607054:0:12962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.607062:0:12962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.607125:0:12962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787692460.607131:0:12962:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787692460.607152:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787692460.607156:0:12962:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787692460.607162:0:12962:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787692460.607198:0:12962:0:(import.c:65:import_set_state_nolock()) ffff92ecb497b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787692460.609888:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874531125903744:0@lo:39:umount.0 00000100:00100000:1.0:1787692460.609956:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692460.611643:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125903744 00000100:00100000:0.0:1787692460.611671:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125903744 00000100:00100000:0.0:1787692460.611736:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787692460.611747:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874531125903744:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787692460.612143:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de0a1 00000100:00080000:0.0:1787692460.612152:0:5833:0:(import.c:65:import_set_state_nolock()) ffff92ecaf630000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1787692460.615177:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692460.615202:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692460.615229:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35aa00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:3.0:1787692460.615233:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692460.615246:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787692460.615253:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692460.615259:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787692460.615261:0:8439:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787692460.615265:0:8439:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787692460.617779:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.617795:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787692460.617835:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.617843:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec8b35aa00/0x5d8b8560a09de317 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de31e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.617858:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692460.617860:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692460.617863:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692460.617870:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787692460.617889:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125903872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787692460.617951:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692460.618001:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125903872 00000100:00100000:1.0:1787692460.618008:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125903872 00000100:00100000:1.0:1787692460.618059:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787692460.618080:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125903872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787692460.618094:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692460.618117:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a2c00/0x5d8b8560a09de31e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de317 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.618129:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692460.618161:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+18:3305:x1874531125903872:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692460.618168:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787692460.618213:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125903872:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787692460.618748:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692460.618893:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1874531125903744:12345-0@lo:39:umount.0 Request processed in 7148us (8935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692460.618902:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787692460.618913:0:5833:0:(genops.c:885:class_export_put()) final put ffff92ecaf631800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1787692460.618969:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ecb497b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:0.0:1787692460.618978:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecaf631800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1787692460.618989:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874531125903744:0@lo:39:umount.0 00000020:00000080:0.0:1787692460.619034:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ecaf630000 for lustre-MDT0000 00000100:00080000:1.0:1787692460.619070:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787692460.619074:0:12962:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787692460.619079:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787692460.621296:0:12962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621314:0:12962:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621321:0:12962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621328:0:12962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621369:0:12962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787692460.621377:0:12962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621384:0:12962:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621390:0:12962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621397:0:12962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621418:0:12962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787692460.621425:0:12962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621432:0:12962:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621438:0:12962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621443:0:12962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621462:0:12962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1787692460.621479:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787692460.621490:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621496:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d6c00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:1.0:1787692460.621500:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621512:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787692460.621518:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692460.621524:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787692460.621526:0:8439:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787692460.621560:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621566:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787692460.621591:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621597:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec813d6c00/0x5d8b8560a09de325 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de32c expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621611:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787692460.621614:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692460.621615:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692460.621620:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424800 already unused, calling callback (ffffffffc1b51c20) 00010000:00010000:3.0:1787692460.621621:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787692460.621622:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692460.621627:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a400 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:3.0:1787692460.621630:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621635:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692460.621637:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787692460.621642:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692460.621647:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1787692460.621649:0:8439:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1787692460.621651:0:8439:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:00010000:3.0:1787692460.621653:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621666:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692460.621668:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787692460.621670:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787692460.621671:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1787692460.621672:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787692460.621685:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621685:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692460.621692:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787692460.621693:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92eca6424800/0x5d8b8560a09de24c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de253 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692460.621697:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692460.621702:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09de540 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de547 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692460.621704:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692460.621706:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692460.621708:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692460.621711:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692460.621713:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692460.621714:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692460.621724:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125904000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787692460.621782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692460.621866:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125904128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787692460.621883:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125904000 00000100:00100000:3.0:1787692460.621890:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125904000 00000100:00100000:1.0:1787692460.621890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692460.621931:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125904128 00000100:00100000:3.0:1787692460.621934:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125904128 00000100:00100000:3.0:1787692460.621956:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787692460.621964:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74f850a3-c102-416a-ae3b-08438aa77de6+19:3305:x1874531125904000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692460.621975:0:8440:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692460.621989:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09de32c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de325 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692460.622000:0:8440:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787692460.622774:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692460.622832:0:12962:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a3c00/0x5d8b8560a09de000 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.622843:0:12962:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a3c00/0x5d8b8560a09de000 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.622850:0:12962:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a3c00/0x5d8b8560a09de000 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.622856:0:12962:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff92ec814a3c00/0x5d8b8560a09de000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.622874:0:12962:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787692460.622878:0:12962:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787692460.622884:0:12962:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787692460.622908:0:12962:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787692460.622912:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787692460.622916:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787692460.622922:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1787692460.622927:0:12962:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff92eb86da4800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787692460.622933:0:12962:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff92eb84e19800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787692460.622940:0:12962:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff92ec904df000 749d9e33-d584-4e2f-a596-9a00b88adda5 192.168.206.27@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787692460.622944:0:12962:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff92eb86da6800 067f46f5-4779-40e6-b53d-5b3e89751501 192.168.206.27@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:0.0:1787692460.622949:0:12962:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff92ec903f8000) has exports, disconnecting them 00000020:00080000:0.0:1787692460.622953:0:12962:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92eb86da4800), last request at 1787692456 00000020:00000080:0.0:1787692460.622960:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de214 00000100:00080000:0.0:1787692460.622986:0:12962:0:(import.c:65:import_set_state_nolock()) ffff92eb86da5000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787692460.623031:0:12962:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92eb86da4800): rc 0 00000020:00000080:0.0:1787692460.623034:0:12962:0:(genops.c:885:class_export_put()) final put ffff92eb86da4800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787692460.623044:0:12962:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92eb84e19800), last request at 1787692456 00000020:00000080:0.0:1787692460.623047:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de149 00000100:00080000:0.0:1787692460.623052:0:12962:0:(import.c:65:import_set_state_nolock()) ffff92eb84e1a000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787692460.623065:0:12962:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92eb84e19800): rc 0 00000020:00000080:0.0:1787692460.623067:0:12962:0:(genops.c:885:class_export_put()) final put ffff92eb84e19800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787692460.623073:0:12962:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa7eb40d87ae0 00000100:00080000:0.0:1787692460.623095:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787692460.623098:0:12962:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787692460.623110:0:12962:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787692460.623170:0:12962:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1787692460.623201:0:12962:0:(import.c:65:import_set_state_nolock()) ffff92ecaec5a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787692460.623219:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787692460.623222:0:12962:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787692460.623229:0:12962:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787692460.623288:0:12962:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787692460.623298:0:12962:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d3f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787692460.623324:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff92ec903f8000) has no exports 00010000:00010000:0.0:1787692460.623353:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692460.623358:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec814a3c00/0x5d8b8560a09de000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.623367:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3c00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692460.623371:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a3c00/0x5d8b8560a09de000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.623379:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec814a3c00/0x5d8b8560a09de000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692460.623393:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a3c00/0x5d8b8560a09de000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692460.623400:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1787692460.623402:0:8439:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1787692460.623404:0:8439:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1787692460.623426:0:8439:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec814a3c00/0x5d8b8560a09de000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.623432:0:8439:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787692460.623447:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec814a3c00/0x5d8b8560a09de000 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.623454:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec814a3c00/0x5d8b8560a09de000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de007 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.623469:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692460.623471:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692460.623474:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692460.623495:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787692460.623519:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+18:3306:x1874531125904128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787692460.623532:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692460.623545:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecc62cac00/0x5d8b8560a09de253 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de24c expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692460.623572:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:2.0:1787692460.623673:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb86da4800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787692460.623714:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb84e19800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787692460.623733:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92eb86da5000 for lustre-MDT0000 00000020:00000080:2.0:1787692460.623737:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92eb84e1a000 for lustre-MDT0000 00010000:00010000:2.0:1787692460.623764:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692460.624659:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692460.625439:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125904384:0@lo:9:umount.0 00000100:00100000:3.0:1787692460.629740:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:74f850a3-c102-416a-ae3b-08438aa77de6+17:3305:x1874531125904000:12345-0@lo:103:ldlm_bl.0 Request processed in 7766us (7948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692460.630074:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787692460.633697:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74f850a3-c102-416a-ae3b-08438aa77de6+16:3306:x1874531125904128:12345-0@lo:103:ldlm_bl.0 Request processed in 10183us (11795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692460.633714:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787692460.633783:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125904256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787692460.633850:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692460.633904:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125904640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787692460.633928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692460.634055:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125904256 00000100:00100000:3.0:1787692460.634065:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125904256 00000100:00100000:3.0:1787692460.634108:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125904640 00000100:00100000:3.0:1787692460.634111:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125904640 00000100:00100000:3.0:1787692460.634129:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787692460.634138:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+17:3307:x1874531125904256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692460.634151:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692460.634171:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6424000/0x5d8b8560a09de547 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de540 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692460.634199:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692460.634212:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125904000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787692460.634234:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf936a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+16:3307:x1874531125904256:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692460.634241:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787692460.634253:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787692460.634259:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf934000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+15:3304:x1874531125904640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692460.634268:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692460.634277:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec813d7200/0x5d8b8560a09de007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de000 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692460.634288:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692460.634320:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf934000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74f850a3-c102-416a-ae3b-08438aa77de6+14:3304:x1874531125904640:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692460.634326:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787692460.634388:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:74f850a3-c102-416a-ae3b-08438aa77de6:3307:1874531125904256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787692460.640059:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125904640:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787692460.641389:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125904128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787692460.641880:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692460.641965:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125904512:0@lo:9:umount.0 00000100:00100000:2.0:1787692460.642003:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692460.648358:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125904384 00000100:00100000:0.0:1787692460.648376:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125904384 00000100:00100000:0.0:1787692460.648527:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125904512 00000100:00100000:0.0:1787692460.648532:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125904512 00000100:00080000:2.0:1787692460.648623:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787692460.648628:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787692460.648661:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787692460.648687:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1874531125904384:12345-0@lo:9:umount.0 00000020:00000080:0.0:1787692460.648722:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de196 00000100:00080000:0.0:1787692460.648733:0:6680:0:(import.c:65:import_set_state_nolock()) ffff92eb850d3000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1787692460.648753:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1787692460.648780:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787692460.649166:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3303:x1874531125904384:12345-0@lo:9:umount.0 Request processed in 494us (7355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692460.652057:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787692460.652090:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1874531125904512:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787692460.652126:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de27d 00000100:00080000:2.0:1787692460.652151:0:6681:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d3b800 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1787692460.652156:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ecaec5a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787692460.652193:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787692460.652195:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787692460.652199:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125904384:0@lo:9:umount.0 00000001:00000004:2.0:1787692460.652209:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787692460.652444:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3303:x1874531125904512:12345-0@lo:9:umount.0 Request processed in 371us (10439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692460.652454:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1787692460.652489:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787692460.652544:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d3f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787692460.652572:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787692460.652574:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787692460.652578:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125904512:0@lo:9:umount.0 00000100:00100000:0.0:1787692460.653688:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000020:00080000:0.0:1787692460.655123:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff92ec903f8000) has no exports 00000020:00000080:0.0:1787692460.726466:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de05b 00000020:00000080:0.0:1787692460.726482:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ecaf971000/lustre-QMT0000_UUID 00000020:01000000:0.0:1787692460.726540:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1787692460.730215:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecaf971000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1787692460.730401:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787692460.730423:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787692460.730428:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff92ec87fd19b8) has no exports 00000020:00000080:2.0:1787692460.730919:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de054 00000020:00000080:2.0:1787692460.730929:0:12962:0:(genops.c:885:class_export_put()) final put ffff92eca64d8000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787692460.730979:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787692460.730986:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787692460.730989:0:12962:0:(genops.c:885:class_export_put()) final put ffff92eca64d8800/lustre-QMT0000_UUID 00000020:00000080:2.0:1787692460.730991:0:12962:0:(genops.c:844:class_export_destroy()) destroying export ffff92eca64d8800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787692460.730996:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1787692460.731148:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92eca64d8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:0.0:1787692461.432879:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 067f46f5-4779-40e6-b53d-5b3e89751501 00000020:00000080:0.0:1787692461.432893:0:7630:0:(genops.c:885:class_export_put()) final put ffff92ecc561e000/067f46f5-4779-40e6-b53d-5b3e89751501 00000001:00100000:0.0:1787692461.432926:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787692461.432928:0:7630:0:(genops.c:885:class_export_put()) final put ffff92ecb4d3b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787692461.435050:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecc561e000/067f46f5-4779-40e6-b53d-5b3e89751501 for lustre-OST0001 00000020:00000080:3.0:1787692461.435125:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecb4d3b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787692461.435156:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ec88171000 for lustre-OST0001 00000020:00000080:3.0:1787692461.435161:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ecb4d3b800 for lustre-OST0001 00000001:00080000:1.0:1787692461.453350:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:1.0:1787692461.453368:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 749d9e33-d584-4e2f-a596-9a00b88adda5 00000001:00080000:1.0:1787692461.453373:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1787692461.453376:0:5853:0:(genops.c:885:class_export_put()) final put ffff92ec904df000/749d9e33-d584-4e2f-a596-9a00b88adda5 00000001:00100000:1.0:1787692461.453397:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 067f46f5-4779-40e6-b53d-5b3e89751501 00000001:00080000:1.0:1787692461.453401:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787692461.453412:0:5853:0:(genops.c:885:class_export_put()) final put ffff92eb86da6800/067f46f5-4779-40e6-b53d-5b3e89751501 00000020:00000080:0.0:1787692461.453502:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec904df000/749d9e33-d584-4e2f-a596-9a00b88adda5 for lustre-MDT0000 00000020:00000080:0.0:1787692461.453559:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb86da6800/067f46f5-4779-40e6-b53d-5b3e89751501 for lustre-MDT0000 00000020:00000080:0.0:1787692461.453959:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ec904d8000 for lustre-MDT0000 00000020:00000080:0.0:1787692461.453968:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92eb86da1800 for lustre-MDT0000 00010000:00010000:2.0:1787692461.569023:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692461.891843:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125904768:0@lo:400:kworker.0 00000100:00100000:1.0:1787692461.891913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692461.892040:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125904768 00000100:00100000:3.0:1787692461.892048:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125904768 00000100:00100000:3.0:1787692461.892114:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1787692461.892124:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec83d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+14:3305:x1874531125904768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692461.892454:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125904896:0@lo:400:kworker.0 00000100:00100000:0.0:1787692461.892493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692461.892506:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874531125905024:0@lo:400:kworker.0 00000100:00100000:2.0:1787692461.892545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692461.892546:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125904896 00000100:00100000:0.0:1787692461.892551:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125904896 00000100:00100000:0.0:1787692461.892590:0:8461:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125905024 00000100:00100000:0.0:1787692461.892594:0:8461:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125905024 00000100:00100000:2.0:1787692461.892598:0:8193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787692461.892606:0:8193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3306:x1874531125904896:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787692461.892614:0:8193:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1787692461.892618:0:8461:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787692461.892625:0:8461:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3307:x1874531125905024:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1787692461.892631:0:8461:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787692461.892657:0:8193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf67e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3306:x1874531125904896:12345-0@lo:400:kworker.0 Request processed in 49us (162us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787692461.892671:0:8461:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3307:x1874531125905024:12345-0@lo:400:kworker.0 Request processed in 44us (127us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787692461.892685:0:8461:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1787692461.892744:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787692461.892749:0:3306:0:(import.c:65:import_set_state_nolock()) ffff92eb8514f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787692461.892753:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1787692461.896568:0:8193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:2.0:1787692461.896666:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787692461.896671:0:3307:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d51800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787692461.896676:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787692461.896681:0:3307:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d51800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787692461.896684:0:3307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 190 00000100:00080000:2.0:1787692461.896692:0:3307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92ecb4d51800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:2.0:1787692461.896728:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ec903b2d80 x1874531125905152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787692461.896754:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874531125905024:0@lo:400:kworker.0 00000100:00100000:2.0:1787692461.896796:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874531125905152:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1787692461.897470:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec83d2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:74f850a3-c102-416a-ae3b-08438aa77de6+14:3305:x1874531125904768:12345-0@lo:400:kworker.0 Request processed in 5343us (5552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692461.897481:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787692461.897673:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125904768:0@lo:400:kworker.0 00000100:00100000:2.0:1787692461.898411:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692461.902350:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125905152 00000100:00100000:1.0:1787692461.902365:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125905152 00000100:00100000:1.0:1787692461.902439:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1787692461.902448:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874531125905152:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1787692461.902465:0:5833:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1787692461.906713:0:3306:0:(import.c:65:import_set_state_nolock()) ffff92eb8514f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787692461.906723:0:3306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 172 00000100:00080000:0.0:1787692461.906732:0:3306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92eb8514f000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:0.0:1787692461.906770:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecaeedb800 x1874531125905280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787692461.906801:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125904896:0@lo:400:kworker.0 00000100:00100000:3.0:1787692461.906845:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874531125905280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787692461.906907:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692461.906953:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125905280 00000100:00100000:3.0:1787692461.906959:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125905280 00000100:00100000:3.0:1787692461.906991:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787692461.906998:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874531125905280:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1787692461.907013:0:5831:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1787692461.907048:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874531125905280:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 49us (141us total) trans 0 rc -19/-19 00000100:00100000:3.0:1787692461.907068:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1787692461.907104:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92eb8514f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787692461.907109:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787692461.907112:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874531125905280:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1787692461.928644:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874531125905152:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 26191us (30231us total) trans 0 rc -19/-19 00000100:00100000:1.0:1787692461.928657:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1787692461.928989:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d51800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787692461.928995:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787692461.929000:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874531125905152:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:3.0:1787692462.596154:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787692462.784952:0:12962:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92ec8b231600 - data ffff92ecb171c360/ffff92ecaf146000 00000020:01000000:2.0:1787692462.785089:0:12962:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92ec908cdba0 - data ffff92ec8f429af8/ffff92ecb5b98c00 00000001:00000004:2.0:1787692462.793265:0:12962:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787692462.879798:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787692462.879806:0:12962:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787692462.879908:0:12962:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787692462.879913:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787692462.880269:0:6815:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787692462.880284:0:6815:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1787692462.880296:0:6815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787692462.883413:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787692462.883422:0:12962:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787692462.883476:0:12962:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787692462.883479:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787692462.883901:0:8078:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787692462.883907:0:8078:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1787692462.883917:0:8078:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787692462.973516:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de023 00000020:00000080:0.0:1787692462.973528:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ecafbce000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787692462.974239:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de038 00000020:00000080:0.0:1787692462.974247:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ec88aad800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787692462.974252:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787692462.974259:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787692462.974268:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787692462.974272:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff92ec903f99b8) has no exports 00000004:01000000:0.0:1787692462.974420:0:12962:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787692462.974429:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de276 00000020:00000080:0.0:1787692462.974433:0:12962:0:(genops.c:885:class_export_put()) final put ffff92eb84e1e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787692462.974438:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787692462.974441:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787692462.974447:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787692462.974449:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff92eb851419b8) has no exports 00000020:00000080:0.0:1787692462.974455:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de26f 00000020:00000080:0.0:1787692462.974458:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ecb4d3d800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787692462.974769:0:12962:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787692462.974773:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787692462.974778:0:12962:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787692462.974783:0:12962:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787692462.974785:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787692462.974836:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787692462.974844:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787692462.974848:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de18f 00000020:00000080:0.0:1787692462.974852:0:12962:0:(genops.c:885:class_export_put()) final put ffff92eb850d1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787692462.974859:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787692462.974862:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787692462.974865:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787692462.974867:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff92ec87e68000) has no exports 00000020:00000080:0.0:1787692462.974871:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de188 00000020:00000080:0.0:1787692462.974885:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ecc5619800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787692462.975155:0:12962:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787692462.975158:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787692462.975160:0:12962:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787692462.975164:0:12962:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787692462.975165:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787692462.975203:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787692462.975208:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787692462.975234:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787692462.975237:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787692462.975260:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de03f 00000020:00000080:0.0:1787692462.975265:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ec88aaf800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787692462.975268:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787692462.975272:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787692462.975274:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787692462.975277:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff92ec903fb370) has no exports 00000020:00000080:0.0:1787692462.975293:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787692462.975295:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787692462.975307:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de046 00000020:00000080:0.0:1787692462.975310:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ec88aaa000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787692462.975316:0:12962:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92ec9dbcc000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787692462.975320:0:12962:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ec9dbcc000 3 00000020:01000004:0.0:1787692462.975322:0:12962:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92ec9dbcc000 from lustre-MDT0000 00000020:00000080:0.0:1787692462.975338:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787692462.975341:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787692462.975343:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ecafbce800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787692462.975346:0:12962:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecafbce800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787692462.975354:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787692462.975415:0:12962:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787692462.975419:0:12962:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787692462.975423:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787692462.975426:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787692462.975428:0:12962:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787692462.975441:0:12962:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff92ec8b241800 74f850a3-c102-416a-ae3b-08438aa77de6 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787692462.975447:0:12962:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff92ec87e6cd28) has exports, disconnecting them 00000020:00080000:0.0:1787692462.975451:0:12962:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff92ec8b241800), last request at 1787692248 00000020:00000080:0.0:1787692462.975464:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09ddfe4 00000020:00010000:0.0:1787692462.975468:0:12962:0:(genops.c:1921:obd_stale_export_put()) Put export ffff92ec8b241800: total 8 00000100:00080000:0.0:1787692462.975472:0:12962:0:(import.c:65:import_set_state_nolock()) ffff92ec8b240000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787692462.975492:0:12962:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92ec8b241800): rc 0 00000020:00080000:0.0:1787692462.975496:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff92ec87e6cd28) has no exports 00000100:00100000:0.0:1787692462.975597:0:5826:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff92ec880f0e00:5826] 2 exiting: rc = 0 00000020:00000080:2.0:1787692462.975739:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecafbce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787692462.975751:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec88aad800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1787692462.975762:0:489:0:(genops.c:885:class_export_put()) final put ffff92ec881e6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787692462.975764:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec881e6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787692462.975767:0:489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787692462.975892:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb84e1e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787692462.975897:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecb4d3d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787692462.975902:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ecb4d3f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787692462.975906:0:489:0:(genops.c:885:class_export_put()) final put ffff92ecb4d39800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787692462.975908:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecb4d39800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787692462.975911:0:489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787692462.975937:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb850d1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787692462.975942:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecc5619800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787692462.975946:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ecaec5a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787692462.975949:0:489:0:(genops.c:885:class_export_put()) final put ffff92eb84e1c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787692462.975951:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb84e1c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787692462.975953:0:489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787692462.976008:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec88aaf800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787692462.976011:0:489:0:(genops.c:885:class_export_put()) final put ffff92ecafbcc800/lustre-MDD0000_UUID 00000020:00000080:2.0:1787692462.976013:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecafbcc800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787692462.976016:0:489:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787692462.976152:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec88aaa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1787692462.976188:0:5825:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff92ec90279200:5825] 1 exiting: rc = 0 00000020:00010000:1.0:1787692462.976365:0:5819:0:(genops.c:1907:obd_stale_export_get()) Get export ffff92ec8b241800: total 0 00010000:00010000:1.0:1787692462.976394:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff92ec8b241800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787692462.976432:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec8b35ac00/0x5d8b8560a09de310 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de309 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692462.976460:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09de2f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de2ed expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692462.976471:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6424a00/0x5d8b8560a09de302 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de2fb expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692462.976481:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec88164400/0x5d8b8560a09de52b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de524 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692462.976492:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecc62cbe00/0x5d8b8560a09de0fc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de0f5 expref: 5 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692462.976505:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92eca6424400/0x5d8b8560a09de33a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de333 expref: 4 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692462.976514:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec88165600/0x5d8b8560a09de539 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de532 expref: 3 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692462.976526:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a2600/0x5d8b8560a09de2e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5d8b8560a09de2df expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692462.976537:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff92ec8b241800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787692462.976549:0:5819:0:(genops.c:885:class_export_put()) final put ffff92ec8b241800/74f850a3-c102-416a-ae3b-08438aa77de6 00010000:00010000:1.0:1787692462.976560:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692462.976562:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692462.976565:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787692462.976571:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec8b241800/74f850a3-c102-416a-ae3b-08438aa77de6 for MGS 00000020:00000080:1.0:1787692462.976598:0:489:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ec8b240000 for MGS 00000100:00100000:3.0:1787692462.976981:0:5823:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff92ec91443c00:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1787692462.977309:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977318:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977324:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977330:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977335:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977341:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977345:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977351:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977355:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977362:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977367:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977373:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977379:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977384:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977390:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977443:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977455:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977460:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977466:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977472:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977478:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977484:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977489:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977495:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977510:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977516:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977521:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977527:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977532:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977538:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977543:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977550:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977556:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977562:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977568:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977574:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977578:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977584:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977589:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977595:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977601:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977607:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977612:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977617:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977622:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977627:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977633:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977638:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977643:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977648:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977654:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977658:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977662:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977666:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977672:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977677:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977683:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977688:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977695:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977707:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977711:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977716:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977722:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692462.977726:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787692462.978638:0:12962:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787692462.978643:0:12962:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1787692462.979341:0:12962:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92ec8b231a80 - data ffff92ecb15f1ca8/ffff92ecaf145000 00000020:01000000:2.0:1787692462.979471:0:12962:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92eca641b300 - data ffff92ecb1758360/ffff92ec87505000 00000020:00000080:2.0:1787692462.980018:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09ddfc8 00000020:00000080:2.0:1787692462.980025:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ec9db04800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787692462.980055:0:12962:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92ec9dbcc000 from MGS, refs=2 00000020:01000004:2.0:1787692462.980058:0:12962:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ec9dbcc000 2 00000020:01000004:2.0:1787692462.980062:0:12962:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92ec9dbcc000 from MGS 00000020:00000080:2.0:1787692462.980081:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787692462.980087:0:12962:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787692462.980089:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ec9db07000/MGS 00000020:00000080:2.0:1787692462.980092:0:12962:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec9db07000/MGS for MGS 00000020:01000000:2.0:1787692462.980097:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787692462.980151:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787692462.980156:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787692462.980161:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787692462.980167:0:12962:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff92ecaf632000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787692462.980183:0:12962:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff92ecaee5b370) has exports, disconnecting them 00000020:00080000:2.0:1787692462.980187:0:12962:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff92ecaf632000), last request at 1787692249 00000020:00000080:2.0:1787692462.980191:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de093 00000020:00080000:2.0:1787692462.980201:0:12962:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92ecaf632000): rc 0 00000020:00000080:2.0:1787692462.980206:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ecaf632000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787692462.980571:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec9db04800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787692462.980580:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecaf632000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787692462.982947:0:12962:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787692462.982956:0:12962:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787692462.982960:0:12962:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787692462.982967:0:12962:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787692462.983158:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787692462.983167:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787692462.983183:0:12962:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ec9dbcc000 1 00000020:00000080:0.0:1787692462.983190:0:12962:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09ddfba 00000020:00000080:0.0:1787692462.983200:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ec9db07800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787692462.983206:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787692462.983210:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787692462.983214:0:12962:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787692462.983218:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff92ec903fcd28) has no exports 00000020:00000080:1.0:1787692462.983283:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ecb497b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787692462.983298:0:8:0:(genops.c:885:class_export_put()) final put ffff92ecafbca800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1787692462.983301:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecafbca800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1787692462.983309:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1787692462.983363:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec9db07800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787692462.994952:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787692462.994966:0:12962:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1787692462.994971:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ec9db03000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787692462.994976:0:12962:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec9db03000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1787692462.994982:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1787692462.995115:0:12962:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92ec9dbcd000 00000020:01000000:1.0:1787692462.995135:0:12962:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1787692462.995150:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787692462.995154:0:12962:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787692462.995158:0:12962:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff92ec87fd4d28) has no exports 00000100:00100000:1.0:1787692462.995231:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff92ec87501c00:5833] 2 exiting: rc = 0 00000100:00100000:3.0:1787692462.995855:0:5831:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff92ec87eac400:5831] 0 exiting: rc = 1 00000100:00100000:3.0:1787692462.995917:0:5832:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff92ec87501000:5832] 1 exiting: rc = 0 00000100:00100000:1.0:1787692462.997393:0:8461:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff92ecb4d05000:8461] 4 exiting: rc = 0 00000100:00100000:1.0:1787692462.997486:0:8193:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff92ecaf163400:8193] 3 exiting: rc = 0 00000100:00100000:0.0:1787692463.000059:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000071:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000077:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000083:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000088:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000094:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000100:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000105:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000111:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000116:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000123:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000129:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000134:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000163:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000180:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000188:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000193:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000199:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000206:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000212:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000218:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000224:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000230:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000236:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000242:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000247:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000253:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000257:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000263:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000268:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000274:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000280:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000286:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000292:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000299:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000304:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000309:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000315:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000320:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000324:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000333:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000338:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000343:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000348:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000353:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000358:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000363:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000368:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000381:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000386:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000393:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000398:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000405:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000411:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000416:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000421:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000427:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000432:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000438:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000443:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000447:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000452:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000457:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.000463:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692463.004190:0:5834:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff92ec87500e00:5834] 0 exiting: rc = 1 00000100:00100000:3.0:1787692463.004422:0:5835:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff92ec87500a00:5835] 1 exiting: rc = 0 00000100:00100000:0.0:1787692463.004732:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004740:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004747:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004753:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004760:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004767:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004773:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004779:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004785:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004791:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004798:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004805:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004854:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004861:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004867:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004872:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004879:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004884:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004890:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004908:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004913:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004919:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004925:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004931:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004936:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004941:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004947:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004952:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004957:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004963:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004969:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004974:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004980:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004986:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004991:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.004997:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005004:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005010:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005016:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005021:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005028:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005033:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005038:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005044:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005049:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005055:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005062:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005068:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005073:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005078:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005083:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005088:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005093:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005099:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005111:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005116:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005122:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005127:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005133:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005289:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005297:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005302:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005307:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.005312:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692463.005849:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff92ec87ffe600:5837] 1 exiting: rc = 0 00000100:00100000:1.0:1787692463.005934:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff92ec87ffe400:5836] 0 exiting: rc = 1 00000100:00100000:0.0:1787692463.006028:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006037:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006043:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006049:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006056:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006063:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006070:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006075:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006080:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006087:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006094:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006110:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006117:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006123:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006130:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006149:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006156:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006164:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006180:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006187:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006194:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006200:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006206:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006228:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006236:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006250:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006256:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006262:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006268:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006274:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006280:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006285:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006290:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006296:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006302:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006322:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006329:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006335:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006341:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006346:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006352:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006357:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006364:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006370:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006375:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006380:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006385:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006405:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006412:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006417:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006423:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006428:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006433:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006439:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006443:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006450:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006455:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006460:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006467:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006486:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006499:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006505:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006511:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.006517:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692463.015661:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff92ec87fff600:5838] 0 exiting: rc = 1 00000100:00100000:3.0:1787692463.015837:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff92ec87ffe200:5839] 1 exiting: rc = 0 00000100:00100000:0.0:1787692463.016094:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016101:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016106:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016111:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016115:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016121:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016127:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016131:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016136:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016295:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016301:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016307:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016312:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016316:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016321:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016326:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016331:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016336:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016342:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016347:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016352:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016356:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016361:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016366:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016371:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016376:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016380:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016384:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016388:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016393:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016398:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016415:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016420:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016425:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016430:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016435:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016440:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016446:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016451:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016457:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016462:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016467:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016473:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016480:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016485:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016490:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016496:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016501:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016507:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016512:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016517:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016522:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016527:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016531:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016536:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016542:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016546:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016552:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016556:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016561:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016567:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016572:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016577:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.016583:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692463.017114:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff92ec87fff200:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1787692463.017367:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff92ec87fffc00:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1787692463.017412:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017426:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017432:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017437:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017442:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017447:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017452:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017458:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017463:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017467:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017473:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017478:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017484:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017488:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017494:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017499:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017505:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017510:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017516:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017521:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017526:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017532:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017536:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017541:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017546:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017552:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017557:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017562:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017567:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017572:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017577:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017582:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017588:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017592:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017598:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017604:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017617:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017622:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017627:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017632:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017637:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017642:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017649:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017654:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017659:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017665:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017671:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017677:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017683:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017688:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017694:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017699:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017704:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017709:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017714:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017719:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017723:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017728:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017734:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017739:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017743:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017747:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017752:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.017757:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692463.018688:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff92ec87ffea00:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1787692463.018761:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff92ec87fff800:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1787692463.019228:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019235:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019241:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019246:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019251:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019256:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019261:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019278:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019283:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019288:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019293:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019298:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019302:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019307:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019313:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019318:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019323:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019328:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019334:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019339:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019344:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019349:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019354:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019360:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019364:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019369:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019375:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019379:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019383:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019388:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019392:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019397:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019402:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019407:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019412:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019417:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019422:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019428:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019433:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019438:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019443:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019448:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019460:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019465:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019470:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019475:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019480:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019485:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019490:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019495:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019500:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019505:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019510:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019515:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019520:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019525:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019530:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019535:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019540:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019545:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019550:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019555:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019560:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.019565:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692463.020097:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff92ec88a92800:5844] 0 exiting: rc = 1 00000100:00100000:1.0:1787692463.020298:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff92ec87fffe00:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1787692463.020457:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff92ec87fffa00:5846] 2 exiting: rc = 0 00000100:00100000:0.0:1787692463.020616:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020623:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020629:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020635:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020641:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020647:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020653:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020660:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020666:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020672:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020678:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020684:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020690:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020710:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020716:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020728:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020735:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020740:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020747:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020752:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020759:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020765:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020772:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020778:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020784:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020790:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020795:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020801:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020806:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020841:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020849:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020855:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020861:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020866:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020872:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020878:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020883:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020889:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020895:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020914:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020921:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020926:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020932:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020938:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020943:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020948:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020954:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020960:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020973:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020979:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020985:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020990:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.020995:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.021001:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.021007:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.021012:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.021018:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.021023:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.021031:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.021036:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.021041:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.021046:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.021052:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692463.021071:0:12962:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787692463.024895:0:12962:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787692463.024907:0:12962:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1787692463.024913:0:12962:0:(genops.c:885:class_export_put()) final put ffff92ec881e2000/MDS_uuid 00000020:00000080:0.0:1787692463.024918:0:12962:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec881e2000/MDS_uuid for MDS 00000020:01000000:0.0:1787692463.024924:0:12962:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1787692463.025050:0:12962:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:0.0:1787692463.478143:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787692463.478154:0:6703:0:(genops.c:885:class_export_put()) final put ffff92eb850d0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787692463.478228:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb850d0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1787692463.478340:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92eb850d3000 for lustre-OST0000 00010000:00010000:2.0:1787692463.621265:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692464.642143:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787692465.356107:0:13115:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1787692465.370023:0:13115:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787692465.370066:0:13115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692465.370080:0:13115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692465.370088:0:13115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692465.370095:0:13115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692465.370115:0:13115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787692465.370141:0:13115:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787692465.370178:0:13115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787692465.370183:0:13115:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787692465.370188:0:13115:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787692465.370194:0:13115:0:(import.c:65:import_set_state_nolock()) ffff92eb8514f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787692465.370199:0:13115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787692465.370200:0:13115:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787692465.370204:0:13115:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787692465.371145:0:13115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692465.371167:0:13115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692465.371174:0:13115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692465.371179:0:13115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692465.371200:0:13115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787692465.371207:0:13115:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692465.371214:0:13115:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692465.371221:0:13115:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692465.371241:0:13115:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692465.371245:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787692465.371254:0:13115:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787692465.371306:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692465.371313:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d7c00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:1.0:1787692465.371317:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692465.371325:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787692465.371393:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692465.371399:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787692465.371402:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787692465.371404:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787692465.371438:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692465.371445:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787692465.371466:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692465.371470:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787692465.371473:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec813d7c00/0x5d8b8560a09de2fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de302 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692465.371475:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692465.371482:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6425600 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692465.371484:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692465.371486:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692465.371489:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692465.371492:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692465.371495:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b800 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:1.0:1787692465.371502:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692465.371504:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692465.371509:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692465.371510:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787692465.371512:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1787692465.371525:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692465.371531:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787692465.371537:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692465.371543:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92eca6425600/0x5d8b8560a09de309 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de310 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692465.371552:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692465.371554:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692465.371556:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692465.371582:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125905408:0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1787692465.371600:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692465.371605:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787692465.371607:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787692465.371620:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692465.371624:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787692465.371639:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692465.371645:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787692465.371646:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692465.371647:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692465.371649:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692465.371658:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeeda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125905536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787692465.371702:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125905664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787692465.371725:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692465.371755:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125905408 00000100:00100000:0.0:1787692465.371761:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125905408 00000100:00100000:0.0:1787692465.371789:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125905664 00000100:00100000:0.0:1787692465.371792:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125905664 00000100:00100000:0.0:1787692465.371809:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787692465.371833:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692465.371834:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec886a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3304:x1874531125905408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787692465.371848:0:5817:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787692465 with bad export cookie 6740627917348134884 00010000:00010000:2.0:1787692465.372690:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692465.372719:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125905536 00000100:00100000:1.0:1787692465.372888:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787692465.372896:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1874531125905664:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787692465.372902:0:8440:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787692465 with bad export cookie 6740627917348134884 00000100:00100000:1.0:1787692465.372964:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3306:x1874531125905664:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1238us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787692465.372971:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1787692465.373008:0:13115:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09de532 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5d8b8560a09de539 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692465.373022:0:13115:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1787692465.373027:0:13115:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1787692465.373029:0:13115:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787692465.373053:0:13115:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787692465.373057:0:13115:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787692465.373061:0:13115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787692465.373066:0:13115:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787692465.373070:0:13115:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff92ecaee5cd28) has no exports 00000020:00080000:3.0:1787692465.373091:0:13115:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff92ecaee5cd28) has no exports 00000100:00100000:2.0:1787692465.373181:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125905536 00000100:00100000:2.0:1787692465.373313:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787692465.373319:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3305:x1874531125905536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1787692465.373324:0:5816:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787692465 with bad export cookie 6740627917348134884 00000100:00100000:2.0:1787692465.373377:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3305:x1874531125905536:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (1564us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787692465.373384:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1787692465.374344:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787692465.374368:0:3305:0:(import.c:65:import_set_state_nolock()) ffff92ec881e2800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787692465.374372:0:3305:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.127@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:3.0:1787692465.381376:0:13115:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92ec90335960 - data ffff92eb8743caf8/ffff92eb84d8a800 00000020:01000000:3.0:1787692465.382496:0:13115:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92ecb239f120 - data ffff92ecb16ead80/ffff92eb850dc800 00000100:00080000:0.0:1787692465.387313:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.127@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787692465.406088:0:3305:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.127@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787692465.406093:0:3305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787692465.406104:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92ecaf6f2a00 x1874531125905408/t0(0) o103->MGC192.168.206.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787692481 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692465.406205:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92ecaeeda300 x1874531125905536/t0(0) o103->MGC192.168.206.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787692481 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692465.406216:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92ecaf6f2d80 x1874531125905664/t0(0) o103->MGC192.168.206.127@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787692481 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787692465.406255:0:3306:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff92ec881e2800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787692465.406276:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:74f850a3-c102-416a-ae3b-08438aa77de6:3306:1874531125905664:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1787692465.406299:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787692465.406303:0:3305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787692465.406305:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787692465.406308:0:3305:0:(import.c:65:import_set_state_nolock()) ffff92ec881e2800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787692465.406313:0:3305:0:(import.c:510:import_select_connection()) MGC192.168.206.127@tcp: connect to NID 0@lo last attempt 154 00000100:00080000:1.0:1787692465.406322:0:3305:0:(import.c:624:import_select_connection()) MGC192.168.206.127@tcp: import ffff92ec881e2800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1787692465.406350:0:3305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecaf6f3100 x1874531125905792/t0(0) o250->MGC192.168.206.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787692465.406424:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74f850a3-c102-416a-ae3b-08438aa77de6:3303:1874531125905792:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1787692465.406462:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874531125905792 offset 0 length 520: 4 00000100:00100000:1.0:1787692465.406635:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeeda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:74f850a3-c102-416a-ae3b-08438aa77de6:3305:1874531125905536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787692465.409548:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec886a7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3304:x1874531125905408:12345-0@lo:103:ldlm_bl.0 Request processed in 37705us (37894us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787692465.409558:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:74f850a3-c102-416a-ae3b-08438aa77de6:3304:1874531125905408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787692465.409566:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00100000:10000000:3.0:1787692465.421538:0:13115:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787692465.479087:0:13115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de118 00000020:00000080:0.0:1787692465.479097:0:13115:0:(genops.c:885:class_export_put()) final put ffff92eb84e19000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1787692465.480340:0:13115:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92ecafbbe800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1787692465.480349:0:13115:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ecafbbe800 2 00000020:01000004:0.0:1787692465.480352:0:13115:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92ecafbbe800 from lustre-OST0000 00000020:00000080:0.0:1787692465.480395:0:13115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787692465.480414:0:13115:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1787692465.480417:0:13115:0:(genops.c:885:class_export_put()) final put ffff92eb84e1d800/lustre-OST0000_UUID 00000020:00000080:0.0:1787692465.480420:0:13115:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb84e1d800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1787692465.480434:0:13115:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1787692465.480492:0:13115:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1787692465.480497:0:13115:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1787692465.480501:0:13115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787692465.480506:0:13115:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787692465.480513:0:13115:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff92eb8514e800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787692465.480519:0:13115:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff92eb85143370) has exports, disconnecting them 00000020:00080000:0.0:1787692465.480524:0:13115:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff92eb8514e800), last request at 1787692266 00000020:00000080:0.0:1787692465.480528:0:13115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de142 00000020:00080000:0.0:1787692465.480541:0:13115:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92eb8514e800): rc 0 00000020:00000080:0.0:1787692465.480546:0:13115:0:(genops.c:885:class_export_put()) final put ffff92eb8514e800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787692465.480684:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb84e19000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787692465.485904:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb8514e800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1787692465.486250:0:13115:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1787692465.486254:0:13115:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787692465.486258:0:13115:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787692465.486263:0:13115:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787692465.486569:0:13115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787692465.486578:0:13115:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1787692465.486584:0:13115:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ecafbbe800 1 00000020:00000080:1.0:1787692465.486590:0:13115:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de0d2 00000020:00000080:1.0:1787692465.486597:0:13115:0:(genops.c:885:class_export_put()) final put ffff92ec904de000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787692465.486694:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92eb8514f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787692465.486700:0:8:0:(genops.c:885:class_export_put()) final put ffff92eb85136000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1787692465.486702:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb85136000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1787692465.486707:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1787692465.486807:0:13115:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787692465.486968:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec904de000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787692465.486997:0:13115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787692465.487004:0:13115:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787692465.487008:0:13115:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff92ec87e699b8) has no exports 00000020:00000080:0.0:1787692465.521720:0:13115:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787692465.521752:0:13115:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787692465.521757:0:13115:0:(genops.c:885:class_export_put()) final put ffff92ecafbbf800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787692465.521762:0:13115:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecafbbf800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787692465.521775:0:13115:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787692465.521953:0:13115:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92ecafbb9800 00000020:02000400:0.0:1787692465.521998:0:13115:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787692465.668993:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692466.689560:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787692467.010421:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 74f850a3-c102-416a-ae3b-08438aa77de6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787692467.010431:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 74f850a3-c102-416a-ae3b-08438aa77de6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787692467.010434:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787692467.010445:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787692467.010449:0:37:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d51800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787692467.010457:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 368 00000100:00080000:3.0:1787692467.010463:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787692467.010470:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92ecb4d51800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:3.0:1787692467.010505:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecaf684380 x1874531125905920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787692467.010584:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874531125905920:0@lo:38:kworker.0 00000400:00000100:2.0:1787692467.010646:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874531125905920 offset 0 length 520: 4 00010000:00010000:1.0:1787692467.713977:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787692467.787354:0:13264:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1787692467.804073:0:13264:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1787692467.804203:0:13264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692467.804221:0:13264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692467.804230:0:13264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692467.804238:0:13264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692467.804264:0:13264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787692467.804270:0:13264:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787692467.804299:0:13264:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787692467.804317:0:13264:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92ecaf684380 x1874531125905920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787692482 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692467.804470:0:13264:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787692467.804480:0:13264:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787692467.804490:0:13264:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d51800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1787692467.804497:0:13264:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787692467.804502:0:13264:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92ecaf684380 x1874531125905920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787692482 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692467.804533:0:13264:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:2.0:1787692467.804559:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692467.804568:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692467.804577:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92eca6424c00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:2.0:1787692467.804585:0:8439:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692467.804596:0:8439:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787692467.804607:0:8439:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692467.804613:0:8439:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787692467.804616:0:8439:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787692467.804620:0:8439:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787692467.804638:0:8439:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92ec881e2800 00010000:00010000:2.0:1787692467.804642:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692467.804661:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92eca6424c00/0x5d8b8560a09de2df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d8b8560a09de2e6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692467.804677:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692467.804678:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692467.804680:0:8439:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692467.807450:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874531125905920:0@lo:38:kworker.0 00000100:00100000:0.0:1787692467.807756:0:13264:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787692467.809253:0:13264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692467.809275:0:13264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692467.809284:0:13264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692467.809292:0:13264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692467.809448:0:13264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692467.809459:0:13264:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692467.809466:0:13264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692467.809473:0:13264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692467.809479:0:13264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692467.810048:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787692467.810061:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692467.810071:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec813d6200 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:1.0:1787692467.810076:0:8438:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692467.810086:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787692467.810095:0:8438:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692467.810111:0:8438:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787692467.810114:0:8438:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1787692467.810131:0:8438:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92ec881e2800 00010000:00010000:1.0:1787692467.810135:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692467.810141:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec813d6200/0x5d8b8560a09de2ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d8b8560a09de2f4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692467.810170:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692467.810173:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692467.810203:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35bc00 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:1.0:1787692467.810206:0:8438:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692467.810214:0:8438:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787692467.810220:0:8438:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692467.810226:0:8438:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787692467.810228:0:8438:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1787692467.810233:0:8438:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92ec881e2800 00010000:00010000:1.0:1787692467.810236:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692467.810242:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692467.810244:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692467.810246:0:8438:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692467.810415:0:13264:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787692467.810422:0:13264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec8b35bc00/0x5d8b8560a09de524 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d8b8560a09de52b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692467.810445:0:13264:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1787692467.810451:0:13264:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1787692467.810454:0:13264:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1787692467.810484:0:13264:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1787692467.810489:0:13264:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1787692467.810495:0:13264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1787692467.810500:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787692467.810502:0:13264:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787692467.810507:0:13264:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff92ecaee599b8) has no exports 00000020:00080000:0.0:1787692467.810549:0:13264:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff92ecaee599b8) has no exports 00000020:01000000:0.0:1787692467.813550:0:13264:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92ecbc3bcea0 - data ffff92eb84b66af8/ffff92eb8520e800 00000020:01000000:0.0:1787692467.813744:0:13264:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff92ecbc3bcde0 - data ffff92ecb17df948/ffff92ecb4d33c00 00100000:10000000:3.0:1787692467.826856:0:13264:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1787692467.857725:0:13264:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de1e3 00000020:00000080:1.0:1787692467.857738:0:13264:0:(genops.c:885:class_export_put()) final put ffff92ecc561e800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1787692467.857836:0:13264:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92eb85134000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1787692467.857841:0:13264:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92eb85134000 2 00000020:01000004:1.0:1787692467.857845:0:13264:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff92eb85134000 from lustre-OST0001 00000020:00000080:1.0:1787692467.857885:0:13264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787692467.857898:0:13264:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1787692467.857901:0:13264:0:(genops.c:885:class_export_put()) final put ffff92eb84e1f800/lustre-OST0001_UUID 00000020:00000080:1.0:1787692467.857904:0:13264:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb84e1f800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1787692467.857912:0:13264:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1787692467.858062:0:13264:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 74f850a3-c102-416a-ae3b-08438aa77de6->MGS 00010000:00010000:1.0:1787692467.858082:0:13264:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb000/0x5d8b8560a09de0f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d8b8560a09de0fc expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787692467.858095:0:13264:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb000/0x5d8b8560a09de0f5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d8b8560a09de0fc expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692467.858102:0:13264:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1787692467.858105:0:13264:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1787692467.858109:0:13264:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1787692467.858269:0:13264:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92ec881e2800 00010000:00010000:1.0:1787692467.858275:0:13264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ecc62cb000/0x5d8b8560a09de0f5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d8b8560a09de0fc expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692467.858295:0:13264:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b000/0x5d8b8560a09de333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5d8b8560a09de33a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787692467.858303:0:13264:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b000/0x5d8b8560a09de333 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5d8b8560a09de33a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692467.858308:0:13264:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787692467.858310:0:13264:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1787692467.858312:0:13264:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1787692467.858322:0:13264:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff92ec881e2800 00010000:00010000:1.0:1787692467.858325:0:13264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b000/0x5d8b8560a09de333 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5d8b8560a09de33a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787692467.858343:0:13264:0:(import.c:65:import_set_state_nolock()) ffff92ec881e2800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1787692467.858348:0:13264:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787692467.858351:0:13264:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787692467.858352:0:13264:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1787692467.858357:0:13264:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787692467.858379:0:13264:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff92ecaf6f3100 x1874531125905792/t0(0) o250->MGC192.168.206.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787692475 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787692467.858400:0:13264:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787692467.858403:0:13264:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:0.0:1787692467.859099:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:74f850a3-c102-416a-ae3b-08438aa77de6:3303:1874531125905792:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:1.0:1787692467.859340:0:13264:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1787692467.859349:0:13264:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09ddfd6 00000020:00000080:1.0:1787692467.859357:0:13264:0:(genops.c:885:class_export_put()) final put ffff92ec881e1800/74f850a3-c102-416a-ae3b-08438aa77de6 00000020:00000080:2.0:1787692467.859645:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecc561e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787692467.859728:0:13264:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.127@tcp (flags='') 00000020:00000080:1.0:1787692467.859736:0:13264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787692467.859745:0:13264:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.127@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1787692467.859749:0:13264:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff92ec87fd3370) has no exports 10000000:01000000:0.0:1787692467.860576:0:5828:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:2.0:1787692467.863130:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec881e1800/74f850a3-c102-416a-ae3b-08438aa77de6 for MGC192.168.206.127@tcp 10000000:01000000:1.0:1787692467.863771:0:13264:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.127@tcp: client import never connected 00000100:00080000:1.0:1787692467.863778:0:13264:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1787692467.863783:0:13264:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1787692467.863787:0:13264:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1787692467.863791:0:13264:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787692467.863864:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ec881e2800 for MGC192.168.206.127@tcp 00000020:00000080:1.0:1787692467.863882:0:13264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787692467.863894:0:13264:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.127@tcp (uuid 74f850a3-c102-416a-ae3b-08438aa77de6) 00000020:00000080:1.0:1787692467.863901:0:13264:0:(genops.c:885:class_export_put()) final put ffff92ec881e5800/74f850a3-c102-416a-ae3b-08438aa77de6 00000020:00000080:1.0:1787692467.863905:0:13264:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec881e5800/74f850a3-c102-416a-ae3b-08438aa77de6 for MGC192.168.206.127@tcp 00000020:01000000:1.0:1787692467.863912:0:13264:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.127@tcp (74f850a3-c102-416a-ae3b-08438aa77de6) 00000020:01000000:1.0:1787692467.864258:0:13264:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1787692467.864274:0:13264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787692467.864282:0:13264:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787692467.864290:0:13264:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff92eb86da0800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787692467.864297:0:13264:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff92ecb4d4b370) has exports, disconnecting them 00000020:00080000:1.0:1787692467.864302:0:13264:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff92eb86da0800), last request at 1787692284 00000020:00000080:1.0:1787692467.864307:0:13264:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de20d 00000020:00080000:1.0:1787692467.864325:0:13264:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff92eb86da0800): rc 0 00000020:00000080:1.0:1787692467.864330:0:13264:0:(genops.c:885:class_export_put()) final put ffff92eb86da0800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787692467.864650:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb86da0800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1787692467.876551:0:13264:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787692467.876566:0:13264:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787692467.876576:0:13264:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787692467.876586:0:13264:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787692467.876768:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1787692467.877009:0:8439:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:2.0:1787692467.877089:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff92ecb4d51800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787692467.877090:0:8438:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1787692467.877238:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1787692467.877484:0:7620:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff92ecaf126800:7620] 2 exiting: rc = 0 00000100:00100000:0.0:1787692467.877512:0:5814:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff92ec881b2400:5814] 0 exiting: rc = 1 00000100:00100000:2.0:1787692467.878121:0:5815:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff92eca6414400:5815] 1 exiting: rc = 0 00000100:00100000:1.0:1787692467.878203:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787692467.878684:0:8440:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff92ecaf121e00:8440] 3 exiting: rc = 0 00000100:00100000:0.0:1787692467.878778:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff92ec881b2000:5816] 0 exiting: rc = 1 00000100:00100000:0.0:1787692467.878879:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff92ec881b3400:5818] 2 exiting: rc = 0 00000100:00100000:0.0:1787692467.878938:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff92ec881b2600:5817] 1 exiting: rc = 0 00000100:00100000:1.0:1787692467.879046:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879054:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879061:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879068:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879075:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879082:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879087:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879094:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879099:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879108:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879114:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879120:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879127:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879134:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879141:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879159:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879166:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879173:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879179:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879185:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879197:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879204:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879210:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879217:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879223:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879228:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879235:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879240:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879246:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879278:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879287:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879295:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879300:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879306:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879311:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879316:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879322:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879327:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879331:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879394:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879401:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879407:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879412:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879420:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879425:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879430:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879435:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879440:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879445:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879450:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879455:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879460:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879467:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879472:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879476:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879481:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879486:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879491:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879499:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879504:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879509:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879514:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879520:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.879525:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787692467.887715:0:13264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787692467.888067:0:13264:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787692467.888075:0:13264:0:(genops.c:885:class_export_put()) final put ffff92ecb4d53800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787692467.888081:0:13264:0:(genops.c:844:class_export_destroy()) destroying export ffff92ecb4d53800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787692467.888099:0:13264:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787692467.888191:0:13264:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92eb85134000 1 00000020:00000080:0.0:1787692467.888199:0:13264:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5d8b8560a09de1b2 00000020:00000080:0.0:1787692467.888207:0:13264:0:(genops.c:885:class_export_put()) final put ffff92ec904d9800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787692467.888278:0:13264:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787692467.888284:0:13264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787692467.888291:0:13264:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787692467.888296:0:13264:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff92eb85144d28) has no exports 00000020:00000080:2.0:1787692467.893609:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec904d9800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787692467.911726:0:13264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787692467.911748:0:13264:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787692467.911756:0:13264:0:(genops.c:885:class_export_put()) final put ffff92eb85136800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787692467.911762:0:13264:0:(genops.c:844:class_export_destroy()) destroying export ffff92eb85136800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787692467.911777:0:13264:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787692467.912028:0:13264:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff92eb85130000 00000020:01000000:3.0:1787692467.912057:0:13264:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787692467.912061:0:13264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787692467.912067:0:13264:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787692467.912072:0:13264:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff92ec87fd0000) has no exports 00000020:00000080:3.0:1787692467.912095:0:13264:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787692467.912102:0:13264:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787692467.912106:0:13264:0:(genops.c:885:class_export_put()) final put ffff92ec904d8800/OSS_uuid 00000020:00000080:3.0:1787692467.912108:0:13264:0:(genops.c:844:class_export_destroy()) destroying export ffff92ec904d8800/OSS_uuid for OSS 00000020:01000000:3.0:1787692467.912126:0:13264:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1787692467.913277:0:5827:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787692467.913894:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff92ec90304600:6681] 2 exiting: rc = 0 00000100:00100000:3.0:1787692467.917984:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff92ecaef4b600:6680] 1 exiting: rc = 0 00000100:00100000:1.0:1787692467.923313:0:8080:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff92ecaf1b9a00:8080] 3 exiting: rc = 0 00000100:00100000:1.0:1787692467.923573:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff92ec943adc00:6679] 0 exiting: rc = 1 00000100:00100000:3.0:1787692467.923750:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924022:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924031:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924040:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924046:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924051:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924057:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924062:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924067:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924073:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924079:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924085:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924090:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924095:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924101:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924107:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924322:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924332:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924404:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924412:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924417:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924423:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924429:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924435:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924442:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924449:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924455:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924461:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924467:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924472:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924478:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924483:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924487:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924492:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924497:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924503:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924519:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924525:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924531:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924536:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924542:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924549:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924554:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924560:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924564:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924569:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924574:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924579:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924585:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924590:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924595:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924600:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924605:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924610:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924687:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924694:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924699:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924705:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924710:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924715:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924720:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924725:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924730:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.924736:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.926325:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff92ecbbd12e00:6683] 1 exiting: rc = 0 00000100:00100000:1.0:1787692467.926447:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff92ecafa9c800:6682] 0 exiting: rc = 1 00000100:00100000:3.0:1787692467.926609:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926630:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926636:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926643:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926649:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926655:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926660:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926679:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926685:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926692:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926698:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926703:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926709:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926714:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926721:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926726:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926732:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926738:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926743:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926749:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926755:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926760:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926766:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926772:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926777:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926784:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926790:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926797:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926802:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926808:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926846:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926852:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926857:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926863:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926868:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926874:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926880:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926886:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926891:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926897:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926903:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926910:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926923:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926929:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926935:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926941:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926947:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926953:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926959:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926965:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926970:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926976:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926982:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926989:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.926994:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.927000:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.927006:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.927012:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.927018:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.927023:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.927030:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.927036:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.927042:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.927048:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.928647:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff92ec89c2f800:6686] 2 exiting: rc = 0 00000100:00100000:2.0:1787692467.929092:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff92ec89c2fa00:6684] 0 exiting: rc = 1 00000100:00100000:1.0:1787692467.929985:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff92ec89c2fc00:6685] 1 exiting: rc = 0 00000100:00100000:3.0:1787692467.930254:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930264:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930271:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930276:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930282:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930288:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930294:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930300:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930309:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930314:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930321:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930326:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930332:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930417:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930423:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930432:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930438:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930444:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930464:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930472:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930477:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930484:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930490:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930496:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930501:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930507:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930513:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930519:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930525:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930531:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930537:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930544:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930550:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930556:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930563:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930569:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930576:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930582:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930588:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930595:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930600:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930606:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930696:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930704:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930710:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930716:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930722:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930727:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930741:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930747:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930754:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930760:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930766:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930772:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930779:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930785:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930792:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930798:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930804:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930809:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930850:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930856:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930862:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.930868:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787692467.937585:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff92ec845dfa00:6687] 0 exiting: rc = 1 00000100:00100000:2.0:1787692467.937791:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff92ec845df000:6688] 1 exiting: rc = 0 00000100:00100000:3.0:1787692467.938063:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938072:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938153:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938160:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938167:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938172:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938178:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938184:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938189:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938194:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938200:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938259:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938265:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938271:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938277:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938282:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938287:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938293:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938298:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938318:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938407:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938415:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938420:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938425:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938431:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938436:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938442:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938451:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938459:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938464:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938470:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938475:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938481:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938487:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938493:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938499:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938504:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938509:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938520:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938526:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938531:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938536:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938542:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938547:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938552:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938558:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938563:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938569:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938574:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938579:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938584:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938589:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938594:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938600:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938683:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938692:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938698:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938703:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938709:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938715:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938720:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938726:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938731:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.938737:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787692467.941244:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff92ec845de800:6689] 0 exiting: rc = 1 00000100:00100000:1.0:1787692467.941448:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff92ec845df400:6690] 1 exiting: rc = 0 00000100:00100000:3.0:1787692467.941571:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941579:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941585:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941592:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941598:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941603:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941609:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941685:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941706:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941714:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941724:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941733:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941742:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941748:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941755:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941763:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941772:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941779:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941786:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.941796:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942035:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942045:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942054:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942062:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942069:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942096:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942103:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942191:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942202:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942208:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942215:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942223:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942247:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942255:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942263:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942269:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942277:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942284:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942292:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942300:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942308:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942316:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942324:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942330:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942420:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942435:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942442:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942448:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942455:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942462:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942469:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942475:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942482:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942488:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942495:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942502:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942525:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942533:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942541:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942547:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942561:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942568:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942574:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787692467.942581:0:13264:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1787692467.962623:0:13264:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787692480.676289:0:13877:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787692488.407761:0:14338:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787692488.407765:0:14338:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787692488.407892:0:14338:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92ec88172800 00000020:01000004:2.0:1787692488.407907:0:14338:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1787692488.407915:0:14338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787692488.407927:0:14338:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff92ecb4d4cd28) 00000020:00000080:2.0:1787692488.407939:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787692488.421441:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787692488.423745:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787692488.424206:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 545: rc = 0 00100000:10000000:2.0:1787692488.424339:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 545: rc = 0 00100000:10000000:2.0:1787692488.424429:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 545: rc = 0 00100000:10000000:2.0:1787692488.424632:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787692488.424763:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 545: rc = 0 00100000:10000000:2.0:1787692488.425127:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 545: rc = 0 00100000:10000000:2.0:1787692488.425221:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 545: rc = 0 00100000:10000000:2.0:1787692488.425459:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 547: rc = 0 00100000:10000000:2.0:1787692488.427231:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 407: rc = 0 00100000:10000000:2.0:1787692488.427336:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 407: rc = 0 00100000:10000000:2.0:1787692488.428496:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 684: rc = 0 00100000:10000000:2.0:1787692488.430185:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 684: rc = 0 00100000:10000000:2.0:1787692488.431848:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 684: rc = 0 00100000:10000000:2.0:1787692488.432240:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 684: rc = 0 00100000:10000000:2.0:1787692488.434640:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 684: rc = 0 00100000:10000000:2.0:1787692488.435206:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 684: rc = 0 00100000:10000000:2.0:1787692488.435840:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 684: rc = 0 00100000:10000000:2.0:1787692488.436261:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 684: rc = 0 00100000:10000000:2.0:1787692488.436527:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 684: rc = 0 00100000:10000000:2.0:1787692488.437115:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 684: rc = 0 00100000:10000000:2.0:1787692488.437446:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 684: rc = 0 00100000:10000000:2.0:1787692488.437946:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 684: rc = 0 00100000:10000000:2.0:1787692488.438455:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 116: rc = 0 00100000:10000000:2.0:1787692488.439046:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 116: rc = 0 00100000:10000000:2.0:1787692488.439623:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 116: rc = 0 00100000:10000000:2.0:1787692488.440247:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 116: rc = 0 00100000:10000000:2.0:1787692488.440758:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 116: rc = 0 00100000:10000000:2.0:1787692488.441213:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 116: rc = 0 00100000:10000000:2.0:1787692488.441529:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 116: rc = 0 00100000:10000000:2.0:1787692488.442200:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 116: rc = 0 00100000:10000000:2.0:1787692488.442534:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 116: rc = 0 00100000:10000000:2.0:1787692488.443076:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 116: rc = 0 00100000:10000000:2.0:1787692488.443757:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 116: rc = 0 00100000:10000000:2.0:1787692488.444557:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 116: rc = 0 00100000:10000000:2.0:1787692488.444852:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 116: rc = 0 00100000:10000000:2.0:1787692488.445160:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 116: rc = 0 00100000:10000000:2.0:1787692488.445675:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 116: rc = 0 00100000:10000000:2.0:1787692488.446107:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 116: rc = 0 00100000:10000000:2.0:1787692488.446507:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 116: rc = 0 00100000:10000000:2.0:1787692488.447028:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 116: rc = 0 00100000:10000000:3.0:1787692488.448118:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 116: rc = 0 00100000:10000000:3.0:1787692488.448457:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 116: rc = 0 00100000:10000000:3.0:1787692488.448781:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 116: rc = 0 00100000:10000000:3.0:1787692488.449071:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 116: rc = 0 00100000:10000000:3.0:1787692488.449337:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 116: rc = 0 00100000:10000000:3.0:1787692488.449592:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 116: rc = 0 00100000:10000000:3.0:1787692488.449926:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 116: rc = 0 00100000:10000000:3.0:1787692488.450192:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 116: rc = 0 00100000:10000000:3.0:1787692488.450450:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 116: rc = 0 00100000:10000000:3.0:1787692488.451067:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 116: rc = 0 00100000:10000000:3.0:1787692488.451555:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 116: rc = 0 00100000:10000000:3.0:1787692488.451896:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 116: rc = 0 00100000:10000000:3.0:1787692488.452165:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 116: rc = 0 00100000:10000000:3.0:1787692488.452487:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 116: rc = 0 00100000:10000000:3.0:1787692488.452923:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 411: rc = 0 00100000:10000000:3.0:1787692488.453537:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787692488.453712:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 408: rc = 0 00100000:10000000:3.0:1787692488.454132:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787692488.454204:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 408: rc = 0 00100000:10000000:3.0:1787692488.454464:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787692488.455849:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 408: rc = 0 00100000:10000000:3.0:1787692488.456544:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787692488.456770:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 103: rc = 0 00100000:10000000:3.0:1787692488.457004:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787692488.457085:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 103: rc = 0 00100000:10000000:3.0:1787692488.457452:0:14338:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787692488.457524:0:14338:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 103: rc = 0 00000020:00000080:3.0:1787692488.457968:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787692488.457976:0:14338:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787692488.457986:0:14338:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09df2d7 00000020:01000004:3.0:1787692488.457994:0:14338:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787692488.457998:0:14338:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787692488.458003:0:14338:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92ec88172800 from MGS 00000020:01000004:3.0:1787692488.458006:0:14338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787692488.458016:0:14338:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff92ecaee58000) 00000020:00000080:3.0:1787692488.458024:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787692488.458085:0:14338:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92ec88172800 from MGS, refs=2 00080000:01000000:3.0:1787692488.458090:0:14338:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787692488.458095:0:14338:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09df2e5 00000100:00100000:3.0:1787692488.458263:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787692488.458389:0:14338:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787692488.458396:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787692488.462079:0:14338:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787692488.462092:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787692488.463447:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787692488.463628:0:14338:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787692488.463635:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787692488.464402:0:14338:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787692488.464410:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787692488.464715:0:14338:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787692488.464721:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787692488.465635:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692488.465639:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692488.465641:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692488.465982:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692488.465984:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692488.465986:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692488.466582:0:14338:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787692488.470611:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787692488.490929:0:14338:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787692488.490946:0:14338:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787692488.490949:0:14338:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787692488.498455:0:14347:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787692488.498678:0:14338:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787692488.498790:0:14338:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787692488.500427:0:14338:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787692488.500808:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787692488.501063:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787692488.501070:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787692488.502435:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787692488.502446:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787692488.505424:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787692488.505434:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787692488.506518:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787692488.506537:0:14338:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.127@tcp' 00000020:01000004:1.0:1787692488.506539:0:14338:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787692488.506566:0:14338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.127@tcp (typ=mgc) 00000020:00000080:1.0:1787692488.506578:0:14338:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.127@tcp (ffff92eb85140000) 00000020:00000080:1.0:1787692488.506593:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787692488.506660:0:14338:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92eb87a02000@MGC192.168.206.127@tcp: add connection 192.168.206.127@tcp at head 00010000:00010000:1.0:1787692488.506844:0:14338:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.127@tcp-0 is initialized 00000040:01000000:1.0:1787692488.506850:0:14338:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787692488.507587:0:14352:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1787692488.517839:0:14354:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787692488.518016:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.127@tcp (uuid 25c21df9-20cc-4624-87d0-9b55ad554e5c) 00000020:00000080:1.0:1787692488.518046:0:14338:0:(genops.c:1385:class_connect()) connect: client 25c21df9-20cc-4624-87d0-9b55ad554e5c, cookie 0x5d8b8560a09df2f3 00000100:00080000:1.0:1787692488.518057:0:14338:0:(import.c:510:import_select_connection()) MGC192.168.206.127@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787692488.518064:0:14338:0:(import.c:624:import_select_connection()) MGC192.168.206.127@tcp: import ffff92eb87a02000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1787692488.518096:0:14338:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecaf6f1500 x1874531125906048/t0(0) o250->MGC192.168.206.127@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787692488.518124:0:14338:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 25c21df9-20cc-4624-87d0-9b55ad554e5c->MGS 00000020:01000004:1.0:1787692488.518154:0:14338:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787692488.518159:0:14338:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787692488.518171:0:14338:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff92eb85144d28) 00000020:00000080:1.0:1787692488.518183:0:14338:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1787692488.520790:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:25c21df9-20cc-4624-87d0-9b55ad554e5c:3303:1874531125906048:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787692488.520887:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692488.522690:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125906048 00000100:00100000:0.0:1787692488.522704:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125906048 00000100:00100000:0.0:1787692488.522751:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787692488.522759:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb850dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1874531125906048:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787692488.522787:0:14349:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 25c21df9-20cc-4624-87d0-9b55ad554e5c@0@lo t0 exp 0000000000000000 cur 394 last 0 00000020:00000080:0.0:1787692488.522843:0:14349:0:(genops.c:1385:class_connect()) connect: client 25c21df9-20cc-4624-87d0-9b55ad554e5c, cookie 0x5d8b8560a09df301 00000100:00080000:0.0:1787692488.522968:0:14349:0:(import.c:65:import_set_state_nolock()) ffff92ecaed75800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787692488.524575:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb850dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+5:3303:x1874531125906048:12345-0@lo:250:mount.lustre.0 Request processed in 1809us (3681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692488.524587:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787692488.524866:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.127@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787692488.524877:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.127@tcp: connect to target with instance 0 00000100:00080000:2.0:1787692488.524885:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.127@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787692488.524889:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787692488.524893:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92eb87a02000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787692488.524896:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787692488.524909:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787692488.524915:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:25c21df9-20cc-4624-87d0-9b55ad554e5c:3303:1874531125906048:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787692488.531110:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787692488.531287:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787692488.531293:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787692488.544054:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787692488.544069:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787692488.545638:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787692488.545651:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787692488.546638:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787692488.546803:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787692488.546809:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787692488.547584:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787692488.547592:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787692488.589320:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787692488.589521:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787692488.589528:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787692488.590792:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787692488.590801:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787692488.591482:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787692488.591647:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787692488.591652:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787692488.592255:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787692488.592262:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787692488.592803:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787692488.593068:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787692488.593074:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787692488.595375:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787692488.595390:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787692488.597438:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787692488.597688:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787692488.597762:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787692488.598529:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787692488.598537:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787692488.630740:0:14338:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787692488.631267:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787692488.631274:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787692488.636979:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787692488.637064:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787692488.642573:0:14338:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787692488.642590:0:14338:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787692488.643712:0:14338:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787692488.643735:0:14338:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787692488.643742:0:14338:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.127@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787692488.644102:0:14338:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787692488.644221:0:14338:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.127@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787692488.644225:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787692488.644227:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787692488.644228:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692488.644230:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692488.644231:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692488.644232:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692488.644234:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787692488.644235:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787692488.644237:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692488.644238:0:14338:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787692488.644240:0:14338:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787692488.644247:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787692488.644248:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787692488.644249:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692488.644250:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692488.644251:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692488.644252:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692488.644253:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787692488.644254:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787692488.644255:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692488.644256:0:14338:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787692488.644281:0:14338:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787692488.644298:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906176:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787692488.644551:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692488.644651:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692488.644702:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125906176 00000100:00100000:0.0:1787692488.644709:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125906176 00000100:00100000:0.0:1787692488.644783:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787692488.644793:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+5:14338:x1874531125906176:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787692488.644890:0:14351:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787692488.644893:0:14351:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787692488.644896:0:14351:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1787692488.645610:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787692488.646161:0:14351:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1787692488.648247:0:14373:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1787692488.648256:0:14373:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1787692488.648260:0:14373:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1787692488.648294:0:14373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787692488.648749:0:14351:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787692488.648759:0:14351:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787692488.662957:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+5:14338:x1874531125906176:12345-0@lo:253:mount.lustre.0 Request processed in 18156us (18397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692488.662970:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787692488.662976:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787692488.663007:0:14338:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787692488.663010:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787692488.663012:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787692488.663013:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692488.663015:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692488.663016:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692488.663017:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692488.663018:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787692488.663020:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787692488.663021:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692488.663023:0:14338:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787692488.663050:0:14338:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92ec88172800 from lustre-MDT0000 10000000:01000000:2.0:1787692488.663072:0:14338:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787692488.663075:0:14338:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787692488.663079:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff92eb85140000 10000000:01000000:2.0:1787692488.663083:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787692488.663090:0:14338:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff92eb85140000 from 1 10000000:01000000:2.0:1787692488.663093:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787692488.663130:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a2400/0x5d8b8560a09df308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692488.663156:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec814a2400/0x5d8b8560a09df308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692488.663166:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec814a2400/0x5d8b8560a09df308 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692488.663184:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787692488.663219:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692488.663253:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f6840 going to sleep for 11 seconds 00000100:00100000:0.0:1787692488.663278:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125906304 00000100:00100000:0.0:1787692488.663284:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125906304 00000100:00100000:0.0:1787692488.663324:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787692488.663333:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+5:14338:x1874531125906304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787692488.663344:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692488.663357:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e0e00/0x5d8b8560a09df30f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df308 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.663378:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e0e00/0x5d8b8560a09df30f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df308 expref: 6 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.663387:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecbc2e0e00/0x5d8b8560a09df30f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df308 expref: 6 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.663396:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0e00, rc 0) 00000100:00100000:0.0:1787692488.663434:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+6:14338:x1874531125906304:12345-0@lo:101:mount.lustre.0 Request processed in 102us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692488.663440:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787692488.663458:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787692488.663472:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec814a2400/0x5d8b8560a09df308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df30f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.663482:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec814a2400/0x5d8b8560a09df308 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df30f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692488.663526:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787692488.663552:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692488.663573:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec84cdc780 going to sleep for 11 seconds 00000100:00100000:2.0:1787692488.663751:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125906432 00000100:00100000:2.0:1787692488.663756:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125906432 00000100:00100000:2.0:1787692488.663930:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787692488.663938:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+6:14338:x1874531125906432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787692488.664169:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+6:14338:x1874531125906432:12345-0@lo:501:mount.lustre.0 Request processed in 230us (614us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787692488.664176:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787692488.664234:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906432:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787692488.664259:0:14338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787692488.664286:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a2400/0x5d8b8560a09df308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df30f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.664294:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec814a2400/0x5d8b8560a09df308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df30f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692488.664301:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92ec88172800 10000000:01000000:1.0:1787692488.664305:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787692488.664308:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff92ec88172800 10000000:01000000:1.0:1787692488.664311:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787692488.664313:0:14338:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff92ec88172800 from 1 10000000:01000000:1.0:1787692488.664316:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787692488.664347:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88164c00/0x5d8b8560a09df316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.664364:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec88164c00/0x5d8b8560a09df316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.664372:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec88164c00/0x5d8b8560a09df316 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692488.664386:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787692488.664417:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692488.664435:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec84cdc780 going to sleep for 11 seconds 00000100:00100000:0.0:1787692488.664438:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125906560 00000100:00100000:0.0:1787692488.664443:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125906560 00000100:00100000:0.0:1787692488.664483:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787692488.664489:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+6:14338:x1874531125906560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787692488.664570:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692488.664581:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e0600/0x5d8b8560a09df31d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df316 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.664596:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e0600/0x5d8b8560a09df31d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df316 expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.664604:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecbc2e0600/0x5d8b8560a09df31d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df316 expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.664611:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0600, rc 0) 00000100:00100000:0.0:1787692488.664653:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+7:14338:x1874531125906560:12345-0@lo:101:mount.lustre.0 Request processed in 164us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692488.664659:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787692488.664668:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787692488.664679:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec88164c00/0x5d8b8560a09df316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df31d expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.664687:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec88164c00/0x5d8b8560a09df316 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df31d expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692488.664705:0:14338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787692488.664719:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88164c00/0x5d8b8560a09df316 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df31d expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.664726:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec88164c00/0x5d8b8560a09df316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df31d expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692488.664732:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787692488.664735:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787692488.664740:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff92ec88172800 10000000:01000000:1.0:1787692488.664743:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787692488.664746:0:14338:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787692488.664748:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787692488.664761:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88165e00/0x5d8b8560a09df324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.664768:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec88165e00/0x5d8b8560a09df324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.664776:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec88165e00/0x5d8b8560a09df324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692488.664787:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906688:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787692488.664828:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692488.664855:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec84cdc780 going to sleep for 11 seconds 00000100:00100000:0.0:1787692488.664940:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125906688 00000100:00100000:0.0:1787692488.664945:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125906688 00000100:00100000:0.0:1787692488.665007:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787692488.665014:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+7:14338:x1874531125906688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787692488.665021:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692488.665028:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e0200/0x5d8b8560a09df32b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df324 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.665051:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e0200/0x5d8b8560a09df32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df324 expref: 8 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.665059:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecbc2e0200/0x5d8b8560a09df32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df324 expref: 8 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.665076:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0200, rc 0) 00000100:00100000:0.0:1787692488.665111:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+8:14338:x1874531125906688:12345-0@lo:101:mount.lustre.0 Request processed in 97us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692488.665117:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787692488.665718:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787692488.665733:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec88165e00/0x5d8b8560a09df324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df32b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692488.665743:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec88165e00/0x5d8b8560a09df324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df32b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692488.665803:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787692488.665856:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692488.665928:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec85f10480 going to sleep for 11 seconds 00000100:00100000:0.0:1787692488.666021:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125906816 00000100:00100000:0.0:1787692488.666027:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125906816 00000100:00100000:0.0:1787692488.666104:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787692488.666113:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+8:14338:x1874531125906816:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787692488.666873:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+9:14338:x1874531125906816:12345-0@lo:501:mount.lustre.0 Request processed in 758us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692488.666881:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787692488.666945:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787692488.666980:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787692488.667020:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692488.667103:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec85f10480 going to sleep for 11 seconds 00000100:00100000:1.0:1787692488.667208:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125906944 00000100:00100000:1.0:1787692488.667214:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125906944 00000100:00100000:1.0:1787692488.667277:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787692488.667292:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+9:14338:x1874531125906944:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787692488.667775:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125906944:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787692488.667775:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+9:14338:x1874531125906944:12345-0@lo:503:mount.lustre.0 Request processed in 483us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692488.667783:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787692488.668293:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25c21df9-20cc-4624-87d0-9b55ad554e5c:14374:1874531125907072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787692488.668451:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692488.668508:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9068f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787692488.668596:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125907072 00000100:00100000:1.0:1787692488.668602:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125907072 00000100:00100000:1.0:1787692488.668664:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787692488.668672:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+9:14374:x1874531125907072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692488.668974:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+9:14374:x1874531125907072:12345-0@lo:502:llog_process_th.0 Request processed in 302us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692488.668980:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787692488.669062:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25c21df9-20cc-4624-87d0-9b55ad554e5c:14374:1874531125907072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787692488.669087:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787692488.669097:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692488.669099:0:14374:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787692488.669106:0:14374:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787692488.669109:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787692488.669123:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff92ec87e699b8) 00000020:00000080:0.0:1787692488.669139:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787692488.669146:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787692488.669208:0:14374:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787692488.669214:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09df339 00000020:00000080:0.0:1787692488.669417:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787692488.669425:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787692488.669428:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692488.669429:0:14374:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787692488.669432:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787692488.669434:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787692488.669436:0:14374:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787692488.669438:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787692488.669444:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff92ec87e6b370) 00000020:00000080:0.0:1787692488.669452:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787692488.669455:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787692488.669457:0:14374:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787692488.669459:0:14374:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787692488.669464:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787692488.669501:0:14374:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92ec88172800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787692488.669513:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff92ec87e6cd28) 00000020:00000080:0.0:1787692488.669526:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787692488.669565:0:14374:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787692488.669570:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d8b8560a09df34e 00000020:00000080:0.0:1787692488.669660:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787692488.669665:0:14374:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787692488.669670:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5d8b8560a09df355 00080000:01000000:0.0:1787692488.669674:0:14374:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787692488.669678:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09df35c 00010000:00010000:2.0:1787692488.768680:0:14374:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787692488.769105:0:14374:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1787692488.769288:0:14374:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787692488.769796:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff92ecb4d499b8) 00000020:00000080:2.0:1787692488.769839:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787692488.769916:0:14374:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787692488.769926:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09df36a 00000020:00000080:2.0:1787692488.774777:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787692488.785046:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5d8b8560a09df371 00000020:00000080:3.0:1787692488.786316:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1787692488.786328:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787692488.786335:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692488.786345:0:14374:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1787692488.786363:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787692488.786366:0:14374:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1787692488.786368:0:14374:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787692488.786370:0:14374:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787692488.786371:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787692488.786374:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692488.786376:0:14374:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787692488.786378:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787692488.786383:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692488.786384:0:14374:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1787692488.786388:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1787692488.786435:0:14374:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1787692488.786455:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787692488.786458:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692488.786459:0:14374:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1787692488.786462:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787692488.786465:0:14374:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787692488.786468:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692488.786470:0:14374:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1787692488.786473:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787692488.786479:0:14374:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.127@tcp to nid 0x20000c0a8ce7f (192.168.206.127@tcp) 00000020:01000000:3.0:1787692488.786516:0:14374:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787692488.786519:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787692488.786535:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff92ecaee599b8) 00000020:00000080:3.0:1787692488.786551:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1787692488.786557:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787692488.786611:0:14374:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1787692488.786616:0:14374:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1787692488.786622:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09df37f 00010000:00080000:3.0:1787692488.786666:0:14374:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92ec91cc2800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.127@tcp at head 00010000:00010000:3.0:1787692488.786931:0:14374:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1787692488.787274:0:14374:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787692488.787326:0:14374:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787692488.788254:0:14374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787692488.788328:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1787692488.788395:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1787692488.790959:0:14378:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787692488.790966:0:14378:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787692488.792086:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787692488.792097:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787692488.792128:0:14374:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787692488.792147:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d8b8560a09df386 00000100:00080000:1.0:1787692488.792157:0:14374:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787692488.792162:0:14374:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92ec91cc2800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1787692488.792196:0:14374:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecaf6f3100 x1874531125907200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787692488.792218:0:14374:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787692488.792286:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692488.792290:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692488.792292:0:14374:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787692488.792294:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787692488.792297:0:14374:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787692488.792299:0:14374:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787692488.792300:0:14374:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787692488.792302:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787692488.792310:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692488.792312:0:14374:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787692488.792315:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787692488.792320:0:14374:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787692488.792335:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692488.792337:0:14374:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787692488.792342:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787692488.792346:0:14374:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.127@tcp to nid 0x20000c0a8ce7f (192.168.206.127@tcp) 00000020:01000000:1.0:1787692488.792378:0:14374:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787692488.792381:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787692488.792392:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff92eb85143370) 00000020:00000080:1.0:1787692488.792404:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787692488.792408:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787692488.792461:0:14374:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787692488.792467:0:14374:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787692488.792473:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5d8b8560a09df394 00010000:00080000:1.0:1787692488.792511:0:14374:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92ecb7096800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.127@tcp at head 00010000:00010000:1.0:1787692488.792716:0:14374:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787692488.792911:0:14374:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787692488.792934:0:14374:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787692488.793424:0:14374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787692488.793484:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787692488.793552:0:14374:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1787692488.794687:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125907200:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787692488.794773:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874531125907200 offset 0 length 520: 4 00000040:00080000:3.0:1787692488.805741:0:14380:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787692488.805749:0:14380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787692488.812443:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787692488.812458:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787692488.812506:0:14374:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787692488.812523:0:14374:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d8b8560a09df39b 00000100:00080000:3.0:1787692488.812533:0:14374:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787692488.812538:0:14374:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92ecb7096800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:3.0:1787692488.812570:0:14374:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecaf686a00 x1874531125907328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787692488.812596:0:14374:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787692488.812648:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787692488.812652:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692488.812654:0:14374:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787692488.812658:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787692488.812661:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692488.812663:0:14374:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787692488.812666:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787692488.812668:0:14374:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787692488.812670:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787692488.812672:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692488.812674:0:14374:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787692488.812676:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787692488.812677:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692488.812678:0:14374:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787692488.812682:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787692488.812714:0:14374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25c21df9-20cc-4624-87d0-9b55ad554e5c:14374:1874531125907456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787692488.812796:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692488.813053:0:14374:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec84dac780 going to sleep for 11 seconds 00000100:00100000:2.0:1787692488.813244:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125907328:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1787692488.813276:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874531125907328 offset 0 length 520: 4 00000100:00080000:1.0:1787692488.813470:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787692488.813475:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787692488.813507:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125907456 00000100:00100000:1.0:1787692488.813513:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125907456 00000100:00100000:1.0:1787692488.813559:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787692488.813569:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+9:14374:x1874531125907456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692488.813808:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+9:14374:x1874531125907456:12345-0@lo:502:llog_process_th.0 Request processed in 240us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692488.813844:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787692488.814121:0:14374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25c21df9-20cc-4624-87d0-9b55ad554e5c:14374:1874531125907456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787692488.814150:0:14374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787692488.814156:0:14374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692488.814158:0:14374:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787692488.814167:0:14374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1787692488.814308:0:14338:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1787692488.814341:0:14338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787692488.814366:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88165e00/0x5d8b8560a09df324 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df32b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.814376:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec88165e00/0x5d8b8560a09df324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df32b expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692488.814383:0:14338:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92ec88172800 from 1 10000000:01000000:1.0:1787692488.814386:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787692488.814414:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.814422:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.814430:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692488.814446:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125907584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787692488.814479:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692488.814681:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec84cdc000 going to sleep for 11 seconds 00000100:00100000:0.0:1787692488.814772:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125907584 00000100:00100000:0.0:1787692488.814778:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125907584 00000100:00100000:0.0:1787692488.814840:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787692488.814848:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+9:14338:x1874531125907584:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787692488.814857:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692488.814869:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e1c00/0x5d8b8560a09df3a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df3a2 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.814888:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e1c00/0x5d8b8560a09df3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df3a2 expref: 10 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.814905:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecbc2e1c00/0x5d8b8560a09df3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df3a2 expref: 10 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.814913:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1c00, rc 0) 00000100:00100000:0.0:1787692488.814948:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+10:14338:x1874531125907584:12345-0@lo:101:mount.lustre.0 Request processed in 102us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692488.814953:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787692488.815067:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125907584:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787692488.815079:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df3a9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692488.815088:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df3a9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692488.815797:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125907712:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787692488.815907:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692488.816049:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec845ed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692488.823742:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125907712 00000100:00100000:2.0:1787692488.823757:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125907712 00000100:00100000:2.0:1787692488.823804:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787692488.823936:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+10:14338:x1874531125907712:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787692488.823959:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787692488.823966:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787692488.824177:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+10:14338:x1874531125907712:12345-0@lo:256:mount.lustre.0 Request processed in 363us (8268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692488.824185:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787692488.824269:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125907712:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787692488.824864:0:14338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787692488.824880:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df3a9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692488.824891:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df3a9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692488.824899:0:14338:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ec88172800 from 1 10000000:01000000:3.0:1787692488.824902:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787692488.824939:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692488.824947:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692488.824957:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692488.824973:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125907840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787692488.825006:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692488.825055:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec845ed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692488.825358:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125907840 00000100:00100000:2.0:1787692488.825364:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125907840 00000100:00100000:2.0:1787692488.825400:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787692488.825408:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+10:14338:x1874531125907840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787692488.825419:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692488.825432:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec814a2a00/0x5d8b8560a09df3b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df3b0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692488.825452:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a2a00/0x5d8b8560a09df3b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df3b0 expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692488.825461:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec814a2a00/0x5d8b8560a09df3b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df3b0 expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692488.825647:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2a00, rc 0) 00000100:00100000:2.0:1787692488.825694:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:14338:x1874531125907840:12345-0@lo:101:mount.lustre.0 Request processed in 286us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692488.825700:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787692488.825979:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125907840:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787692488.825993:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df3b7 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692488.826002:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df3b7 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692488.826068:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125907968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787692488.826096:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692488.826152:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec845ed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692488.826208:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125907968 00000100:00100000:1.0:1787692488.826213:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125907968 00000100:00100000:1.0:1787692488.826250:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787692488.826258:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:14338:x1874531125907968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787692488.826915:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:14338:x1874531125907968:12345-0@lo:501:mount.lustre.0 Request processed in 655us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692488.826930:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787692488.828559:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125907968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787692488.828619:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125908096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787692488.828685:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692488.828718:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec845ed0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692488.828853:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125908096 00000100:00100000:2.0:1787692488.828859:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125908096 00000100:00100000:2.0:1787692488.828905:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787692488.828914:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:14338:x1874531125908096:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787692488.829108:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:14338:x1874531125908096:12345-0@lo:503:mount.lustre.0 Request processed in 194us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692488.829116:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787692488.830851:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125908096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787692488.842263:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25c21df9-20cc-4624-87d0-9b55ad554e5c:14382:1874531125908224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787692488.842552:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692488.842644:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec87d90180 going to sleep for 11 seconds 00000100:00100000:0.0:1787692488.842971:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125908224 00000100:00100000:0.0:1787692488.842980:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125908224 00000100:00100000:0.0:1787692488.843071:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787692488.843082:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:14382:x1874531125908224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787692488.843425:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:14382:x1874531125908224:12345-0@lo:502:llog_process_th.0 Request processed in 270us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692488.843435:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787692488.843541:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25c21df9-20cc-4624-87d0-9b55ad554e5c:14382:1874531125908224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787692488.843570:0:14382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787692488.843579:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787692488.843581:0:14382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787692488.843589:0:14382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ec88172800 00000020:00000080:2.0:1787692488.843591:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787692488.843599:0:14382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787692488.843601:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787692488.843618:0:14382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787692488.843622:0:14382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787692488.843625:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787692488.843626:0:14382:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787692488.843637:0:14382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ec88172800 00000020:00000080:2.0:1787692488.843640:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787692488.843696:0:14382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787692488.843700:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787692488.843702:0:14382:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787692488.843705:0:14382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787692488.843707:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787692488.843709:0:14382:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787692488.843713:0:14382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92ec88172800 00000020:00000080:2.0:1787692488.843715:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787692488.843755:0:14382:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25c21df9-20cc-4624-87d0-9b55ad554e5c:14382:1874531125908352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787692488.843794:0:14382:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692488.847997:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125908352 00000100:00100000:1.0:1787692488.848010:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125908352 00000100:00100000:1.0:1787692488.848072:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787692488.848083:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:14382:x1874531125908352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692488.848354:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:14382:x1874531125908352:12345-0@lo:502:llog_process_th.0 Request processed in 260us (4546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692488.848363:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787692488.852711:0:14382:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec87d90180 going to sleep for 11 seconds 00000100:00100000:2.0:1787692488.852749:0:14382:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25c21df9-20cc-4624-87d0-9b55ad554e5c:14382:1874531125908352:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787692488.852787:0:14382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787692488.852795:0:14382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787692488.852798:0:14382:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787692488.852803:0:14382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787692488.853058:0:14338:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787692488.853081:0:14338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787692488.853099:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df3b7 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.853123:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df3b7 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692488.853183:0:14338:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787692488.853186:0:14338:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92ec88172800 10000000:01000000:0.0:1787692488.853189:0:14338:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92ec88172800 10000000:01000000:0.0:1787692488.853194:0:14338:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787692488.853200:0:14338:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ec88172800 from 1 10000000:01000000:0.0:1787692488.853210:0:14338:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787692488.853243:0:14338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e0400/0x5d8b8560a09df3be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.853253:0:14338:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e0400/0x5d8b8560a09df3be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692488.853271:0:14338:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e0400/0x5d8b8560a09df3be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692488.853292:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125908480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787692488.853347:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692488.853368:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb810f69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692488.854203:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125908480 00000100:00100000:1.0:1787692488.854213:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125908480 00000100:00100000:1.0:1787692488.854383:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787692488.854393:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:14338:x1874531125908480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787692488.854407:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692488.854423:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec88165a00/0x5d8b8560a09df3c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df3be expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.854444:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec88165a00/0x5d8b8560a09df3c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df3be expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.854454:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec88165a00/0x5d8b8560a09df3c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df3be expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.854461:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165a00, rc 0) 00000100:00100000:1.0:1787692488.854521:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14338:x1874531125908480:12345-0@lo:101:mount.lustre.0 Request processed in 129us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692488.854527:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787692488.854592:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125908480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787692488.854713:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e0400/0x5d8b8560a09df3be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df3c5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692488.854725:0:14338:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e0400/0x5d8b8560a09df3be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df3c5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692488.854793:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125908608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787692488.854849:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692488.858579:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125908608 00000100:00100000:0.0:1787692488.858592:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125908608 00000100:00100000:2.0:1787692488.858606:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec87d90180 going to sleep for 11 seconds 00000100:00100000:0.0:1787692488.858691:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787692488.858701:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14338:x1874531125908608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787692488.859025:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14338:x1874531125908608:12345-0@lo:501:mount.lustre.0 Request processed in 325us (4174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692488.859043:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787692488.859130:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125908608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787692488.859202:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125908736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787692488.859248:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692488.859932:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec87d90180 going to sleep for 11 seconds 00000100:00100000:1.0:1787692488.859990:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125908736 00000100:00100000:1.0:1787692488.860004:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125908736 00000100:00100000:1.0:1787692488.860049:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787692488.860058:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14338:x1874531125908736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787692488.860306:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14338:x1874531125908736:12345-0@lo:503:mount.lustre.0 Request processed in 248us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692488.860315:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787692488.860387:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125908736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787692488.860697:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25c21df9-20cc-4624-87d0-9b55ad554e5c:14387:1874531125908864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692488.860736:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692488.860793:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec84465cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692488.860880:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125908864 00000100:00100000:2.0:1787692488.860885:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125908864 00000100:00100000:1.0:1787692488.861103:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787692488.861112:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14387:x1874531125908864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692488.861302:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14387:x1874531125908864:12345-0@lo:502:llog_process_th.0 Request processed in 190us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692488.861310:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787692488.861439:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25c21df9-20cc-4624-87d0-9b55ad554e5c:14387:1874531125908864:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787692488.861499:0:14387:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787692488.861514:0:14387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff92eb851419b8) 00000020:00000080:1.0:1787692488.861532:0:14387:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787692488.861611:0:14387:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92ec88172800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787692488.861616:0:14387:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92ec88172800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787692488.861619:0:14387:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ec88172800 4 00010000:00080000:1.0:1787692488.861651:0:14387:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92ecb4d55800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.127@tcp at head 00010000:00010000:1.0:1787692488.864563:0:14387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787692488.864929:0:14387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787692488.864969:0:14387:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787692488.864982:0:14387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5d8b8560a09df3d3 00000100:00080000:1.0:1787692488.864992:0:14387:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787692488.865005:0:14387:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff92ecb4d55800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1787692488.865057:0:14387:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecaf6f2a00 x1874531125908992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787692488.865091:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874531125908992:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787692488.865156:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787692488.865211:0:14387:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787692488.865231:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787692488.865235:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787692488.865373:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125908992 00000100:00100000:0.0:1787692488.865383:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125908992 00000100:00100000:0.0:1787692488.865422:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787692488.865431:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874531125908992:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787692488.865502:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874531125908992:12345-0@lo:38:llog_process_th.0 Request processed in 70us (346us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787692488.865510:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787692488.866447:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787692488.866529:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d55800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787692488.866536:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787692488.866540:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874531125908992:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787692488.868421:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25c21df9-20cc-4624-87d0-9b55ad554e5c:14387:1874531125909120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692488.868508:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692488.868544:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8b19ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787692488.868567:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125909120 00000100:00100000:1.0:1787692488.868573:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125909120 00000100:00100000:1.0:1787692488.868621:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787692488.868630:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14387:x1874531125909120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787692488.870208:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14387:x1874531125909120:12345-0@lo:502:llog_process_th.0 Request processed in 1572us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692488.870220:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787692488.870778:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:25c21df9-20cc-4624-87d0-9b55ad554e5c:14387:1874531125909120:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787692488.870845:0:14387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787692488.870923:0:14338:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787692488.870949:0:14338:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787692488.870969:0:14338:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e0400/0x5d8b8560a09df3be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df3c5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692488.870979:0:14338:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e0400/0x5d8b8560a09df3be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df3c5 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787692488.871027:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787692488.871040:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787692488.871042:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692488.871043:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692488.871045:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692488.871046:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692488.871047:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787692488.871049:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787692488.871051:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692488.871053:0:14338:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787692488.871056:0:14338:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787692488.871059:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787692488.871060:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787692488.871062:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692488.871063:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692488.871064:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692488.871065:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692488.871066:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787692488.871067:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787692488.871075:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692488.871075:0:14338:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787692488.871096:0:14338:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787692488.871111:0:14338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125909248:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787692488.871172:0:14338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692488.871202:0:14338:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec87d90780 going to sleep for 11 seconds 00000100:00100000:1.0:1787692488.871752:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125909248 00000100:00100000:1.0:1787692488.871759:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125909248 00000100:00100000:1.0:1787692488.871805:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787692488.872046:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14338:x1874531125909248:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787692488.872071:0:14351:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787692488.872084:0:14351:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787692488.907180:0:14351:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787692488.907197:0:14351:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787692488.909091:0:14372:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787692488.909101:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787692488.909125:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692488.909143:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ecbc2e1c00/0x5d8b8560a09df3a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df3a2 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692488.909150:0:14372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692488.909187:0:14372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ecbc2e1c00/0x5d8b8560a09df3a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09df3a2 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692488.909200:0:14372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ecbc2e1c00/0x5d8b8560a09df3a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09df3a2 expref: 12 pid: 14349 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692488.909214:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1874531125909376:0@lo:104: 00000100:00100000:3.0:1787692488.909272:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692488.909318:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec901ea240 going to sleep for 11 seconds 00000100:00100000:1.0:1787692488.909396:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125909376 00000100:00100000:1.0:1787692488.909403:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125909376 00000100:00100000:1.0:1787692488.909451:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787692488.909461:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+3:14372:x1874531125909376:12345-0@lo:104: 00010000:00010000:1.0:1787692488.909474:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df3a9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909525:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787692488.909531:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+3:14372:x1874531125909376:12345-0@lo:104: Request processed in 72us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692488.909537:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787692488.909559:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692488.909564:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df3a9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909571:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164200 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:1.0:1787692488.909575:0:14345:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09df3a9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909583:0:14345:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09df3a9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787692488.909590:0:14345:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09df3a9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692488.909611:0:14345:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787692488.909639:0:14345:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df3a9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909646:0:14345:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787692488.909664:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df3a9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909671:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec88164200/0x5d8b8560a09df3a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df3a9 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909687:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692488.909689:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692488.909691:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692488.909718:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25c21df9-20cc-4624-87d0-9b55ad554e5c:3307:1874531125909504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787692488.909747:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692488.909796:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125909504 00000100:00100000:1.0:1787692488.909801:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125909504 00010000:00010000:1.0:1787692488.909834:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ecbc2e1c00/0x5d8b8560a09df3a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df3a2 expref: 13 pid: 14349 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692488.909856:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787692488.909863:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+13:3307:x1874531125909504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787692488.909873:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692488.909878:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ecbc2e1c00/0x5d8b8560a09df3a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df3a2 expref: 13 pid: 14349 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909887:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ecbc2e1c00/0x5d8b8560a09df3a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09df3a2 expref: 13 pid: 14349 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909909:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909916:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787692488.909928:0:14341:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000828480s 00010000:00010000:1.0:1787692488.909932:0:14341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909938:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909945:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909951:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909955:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35be00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692488.909959:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909965:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909973:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.909982:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692488.910253:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+13:3307:x1874531125909504:12345-0@lo:103:ldlm_bl.0 Request processed in 390us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692488.910266:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787692488.910328:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecbc2e1c00/0x5d8b8560a09df3a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09df3a2 expref: 12 pid: 14349 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692488.910339:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1874531125909376:0@lo:104: 00010000:00010000:1.0:1787692488.910358:0:14372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.910366:0:14372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.910372:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692488.910378:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df3da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692488.910717:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:25c21df9-20cc-4624-87d0-9b55ad554e5c:3307:1874531125909504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787692488.916143:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:14338:x1874531125909248:12345-0@lo:253:mount.lustre.0 Request processed in 44093us (44963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692488.916156:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787692488.916230:0:14338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:14338:1874531125909248:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787692488.916243:0:14338:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787692488.916246:0:14338:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787692488.916248:0:14338:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787692488.916250:0:14338:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692488.916251:0:14338:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692488.916252:0:14338:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692488.916253:0:14338:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692488.916254:0:14338:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787692488.916256:0:14338:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787692488.916257:0:14338:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692488.916259:0:14338:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787692488.916272:0:14338:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787692488.920503:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692488.920672:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787692488.920986:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692488.921178:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787692488.921447:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692488.921605:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1787692488.922529:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692488.922937:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1787692488.923290:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692488.923495:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787692488.923768:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692488.924055:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1787692488.946734:0:14338:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1787692488.947203:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1787692488.947626:0:14396:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1787692488.947693:0:14396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787692488.951905:0:14396:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787692488.951989:0:14396:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787692488.951994:0:14396:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1787692488.952602:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787692488.952743:0:14338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1787692488.953199:0:14395:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1787692488.953204:0:14395:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:1.0:1787692488.953614:0:14338:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787692488.953624:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787692488.954102:0:14338:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787692488.955306:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787692488.956089:0:14338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787692488.956135:0:14338:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787692488.956578:0:14338:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1787692488.957440:0:14338:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1787692488.963099:0:14338:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787692488.995588:0:14338:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787692488.995628:0:14338:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa7eb41dab988 00100000:10000000:2.0:1787692488.995636:0:14338:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787692488.996483:0:14338:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787692488.996497:0:14338:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787692488.996509:0:14338:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787692488.996524:0:14338:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787692489.478371:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787692489.921241:0:14390:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787692489.921251:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787692489.921642:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1787692489.921649:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1787692490.378462:0:14354:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787692490.378471:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92ec88172800 from 6 10000000:01000000:0.0:1787692490.378477:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787692490.378525:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692490.378539:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692490.378550:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692490.378574:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125909632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787692490.378642:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692490.379577:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb49543c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692490.383699:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125909632 00000100:00100000:3.0:1787692490.383714:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125909632 00000100:00100000:3.0:1787692490.383772:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787692490.383783:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:14354:x1874531125909632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787692490.383802:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692490.383851:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec8b35a400/0x5d8b8560a09df3e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df3e1 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692490.383878:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec8b35a400/0x5d8b8560a09df3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df3e1 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692490.383889:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec8b35a400/0x5d8b8560a09df3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df3e1 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692490.383897:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35a400, rc 0) 00000100:00100000:3.0:1787692490.384002:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14354:x1874531125909632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (5358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692490.384010:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787692490.387009:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125909632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787692490.387045:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df3e8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692490.387058:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df3e8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692490.387135:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125909760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787692490.387192:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692490.387232:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecaef673c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692490.387531:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125909760 00000100:00100000:3.0:1787692490.387538:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125909760 00000100:00100000:3.0:1787692490.387592:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787692490.387600:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14354:x1874531125909760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787692490.387620:0:14351:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787692490.387639:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787692490.387642:0:14351:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787692490.387714:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14354:x1874531125909760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692490.387722:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787692490.387765:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125909760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787692490.387801:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787692490.387807:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df3e8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692490.387842:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df3e8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692490.497111:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787692490.945090:0:14390:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787692490.945100:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787692490.945158:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1787692490.945164:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787692491.521520:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692492.545524:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787692492.917495:0:14638:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787692493.569047:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787692494.147896:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787692494.147902:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787692494.147906:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787692494.147909:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787692494.147920:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787692494.147923:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787692494.147927:0:8:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d55800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787692494.147938:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff92ecb4d55800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:0.0:1787692494.147958:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecaeed9f80 x1874531125910016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787692494.148024:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125909888:0@lo:400:kworker.0 00000100:00100000:0.0:1787692494.148085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692494.148138:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125909888 00000100:00100000:0.0:1787692494.148144:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125909888 00000100:00100000:0.0:1787692494.148180:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787692494.148188:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:3304:x1874531125909888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692494.148233:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:3304:x1874531125909888:12345-0@lo:400:kworker.0 Request processed in 46us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692494.148240:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787692494.148299:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125909888:0@lo:400:kworker.0 00000100:00100000:0.0:1787692494.148321:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874531125910016:0@lo:38:kworker.0 00000100:00100000:0.0:1787692494.148348:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692494.148377:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125910016 00000100:00100000:0.0:1787692494.148381:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125910016 00000100:00100000:0.0:1787692494.148397:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787692494.148401:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874531125910016:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1787692494.148418:0:14358:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 400 last 0 00000020:00000080:0.0:1787692494.148448:0:14358:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5d8b8560a09df3ef 00000004:00100000:0.0:1787692494.148462:0:14358:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787692494.148627:0:14358:0:(import.c:65:import_set_state_nolock()) ffff92eca64dd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787692494.148668:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874531125910016:12345-0@lo:38:kworker.0 Request processed in 265us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692494.148674:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787692494.148742:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92ecaeed9f80 x1874531125910016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787692504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787692494.148763:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787692494.148772:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787692494.148777:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787692494.148779:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ecb4d55800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787692494.148785:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874531125910016:0@lo:38:kworker.0 00010000:00010000:1.0:1787692494.592919:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787692495.442745:0:14790:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb0b5b240 20000000:00000080:3.0:1787692495.442763:0:14790:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92ec90d18800 uarg=0000000000000000 20000000:01000000:3.0:1787692495.442797:0:14790:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787692495.442804:0:14790:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787692495.442810:0:14790:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787692495.445853:0:14791:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787692495.446047:0:14790:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787692495.457970:0:14790:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787692495.458011:0:14790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692495.458030:0:14790:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec814a2a00/0x5d8b8560a09df3b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df3b0 expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692495.458039:0:14790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692495.458081:0:14790:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec814a2a00/0x5d8b8560a09df3b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09df3b0 expref: 11 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692495.458097:0:14790:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ec814a2a00/0x5d8b8560a09df3b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09df3b0 expref: 11 pid: 14349 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692495.458112:0:14790:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14790:1874531125910144:0@lo:104: 00000100:00100000:1.0:1787692495.458618:0:14790:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692495.458682:0:14790:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9144e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692495.458841:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125910144 00000100:00100000:2.0:1787692495.458849:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125910144 00000100:00100000:2.0:1787692495.458894:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787692495.458904:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25c21df9-20cc-4624-87d0-9b55ad554e5c+3:14790:x1874531125910144:12345-0@lo:104: 00010000:00010000:2.0:1787692495.458917:0:14340:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df3b7 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692495.459012:0:14340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787692495.459020:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25c21df9-20cc-4624-87d0-9b55ad554e5c+3:14790:x1874531125910144:12345-0@lo:104: Request processed in 117us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692495.459028:0:14790:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14790:1874531125910144:0@lo:104: 00000100:00100000:2.0:1787692495.459029:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787692495.459055:0:14790:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459090:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692495.459097:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df3b7 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459105:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b800 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:0.0:1787692495.459109:0:14344:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09df3b7 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459117:0:14344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09df3b7 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787692495.459124:0:14344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09df3b7 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692495.459130:0:14344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787692495.459168:0:14344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df3b7 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459191:0:14344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787692495.459212:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df3b7 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459218:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df3b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df3b7 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459234:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692495.459236:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692495.459237:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692495.459248:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25c21df9-20cc-4624-87d0-9b55ad554e5c:3305:1874531125910272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787692495.459282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692495.459326:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125910272 00000100:00100000:0.0:1787692495.459330:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125910272 00010000:00010000:0.0:1787692495.459349:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec814a2a00/0x5d8b8560a09df3b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df3b0 expref: 12 pid: 14349 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692495.459370:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787692495.459376:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeeda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:3305:x1874531125910272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787692495.459386:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692495.459392:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec814a2a00/0x5d8b8560a09df3b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df3b0 expref: 12 pid: 14349 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459403:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec814a2a00/0x5d8b8560a09df3b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09df3b0 expref: 12 pid: 14349 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459417:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a2a00/0x5d8b8560a09df3b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09df3b0 expref: 12 pid: 14349 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459442:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459449:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459461:0:14341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459469:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459476:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459482:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459487:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692495.459491:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459498:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459519:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692495.459529:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692495.459556:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeeda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:3305:x1874531125910272:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692495.459568:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787692495.459597:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25c21df9-20cc-4624-87d0-9b55ad554e5c:3305:1874531125910272:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787692495.460110:0:14790:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692495.460121:0:14790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692495.460136:0:14790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec88165600/0x5d8b8560a09df3f6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692495.617425:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692496.641852:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787692497.473747:0:14354:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787692497.473754:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ec88172800 from 10 10000000:01000000:3.0:1787692497.473774:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787692497.473832:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692497.473843:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692497.473853:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692497.473877:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125910400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787692497.473962:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692497.474030:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec880cb300 going to sleep for 11 seconds 00000100:00100000:2.0:1787692497.474160:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125910400 00000100:00100000:2.0:1787692497.474168:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125910400 00000100:00100000:2.0:1787692497.474225:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787692497.474236:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+11:14354:x1874531125910400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787692497.474248:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692497.474263:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09df404 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df3fd expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692497.474284:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09df404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df3fd expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692497.474305:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09df404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df3fd expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692497.474313:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3600, rc 0) 00000100:00100000:2.0:1787692497.474368:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14354:x1874531125910400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692497.474375:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787692497.475144:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125910400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787692497.475161:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df404 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692497.475170:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df404 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692497.475233:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125910528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787692497.475267:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692497.475299:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec880cb300 going to sleep for 11 seconds 00000100:00100000:0.0:1787692497.475390:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125910528 00000100:00100000:0.0:1787692497.476547:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125910528 00000100:00100000:0.0:1787692497.476605:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787692497.476615:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14354:x1874531125910528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787692497.476909:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14354:x1874531125910528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692497.476917:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787692497.477090:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125910528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692497.477148:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125910656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692497.477204:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692497.477226:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec905cbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787692497.478330:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125910656 00000100:00100000:0.0:1787692497.478341:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125910656 00000100:00100000:0.0:1787692497.478404:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787692497.478415:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14354:x1874531125910656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787692497.478651:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:14354:x1874531125910656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (1445us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692497.478660:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787692497.478786:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125910656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787692497.481619:0:14890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787692497.481702:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787692497.481739:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787692497.481750:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df404 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692497.481762:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df404 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692497.671466:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692498.243439:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787692488/real 1787692488] req@ffff92ecaf686a00 x1874531125907328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787692498 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692498.243468:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92ecaf686a00 x1874531125907328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787692498 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692498.243578:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787692488/real 1787692488] req@ffff92ecaf6f3100 x1874531125907200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787692498 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692498.243593:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92ecaf6f3100 x1874531125907200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787692498 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787692498.243611:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ecb7096800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787692498.243671:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787692498.243676:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125907328:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787692498.243682:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ec91cc2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1787692498.243768:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25c21df9-20cc-4624-87d0-9b55ad554e5c:3306:1874531125910784:0@lo:400:kworker.0 00000100:00100000:0.0:1787692498.243852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787692498.243938:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787692498.243942:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787692498.243956:0:37:0:(import.c:65:import_set_state_nolock()) ffff92ec91cc2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787692498.243961:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 394 00000100:00080000:2.0:1787692498.243967:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787692498.243973:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92ec91cc2800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:2.0:1787692498.244009:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ec903b1500 x1874531125910912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787692498.244021:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787692498.244025:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787692498.244026:0:37:0:(import.c:65:import_set_state_nolock()) ffff92ecb7096800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787692498.244029:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 395 00000100:00080000:2.0:1787692498.244032:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787692498.244035:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92ecb7096800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:2.0:1787692498.244048:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ec903b3480 x1874531125911040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787692498.244178:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787692498.244183:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125907200:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1787692498.244209:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125910912:0@lo:8:kworker.0 00000400:00000100:3.0:1787692498.244238:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874531125910912 offset 0 length 520: 4 00000100:00100000:3.0:1787692498.244258:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125911040:0@lo:8:kworker.0 00000400:00000100:3.0:1787692498.244276:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874531125911040 offset 0 length 520: 4 00000100:00100000:0.0:1787692498.244330:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692498.244337:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125911168:0@lo:400:kworker.0 00000100:00100000:0.0:1787692498.244370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692498.244449:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125910784 00000100:00100000:0.0:1787692498.244456:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125910784 00000100:00100000:0.0:1787692498.244499:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787692498.244514:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec89c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:3306:x1874531125910784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692498.244559:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec89c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:3306:x1874531125910784:12345-0@lo:400:kworker.0 Request processed in 47us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692498.244566:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787692498.244618:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25c21df9-20cc-4624-87d0-9b55ad554e5c:3306:1874531125910784:0@lo:400:kworker.0 00000100:00100000:3.0:1787692498.244746:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125911168 00000100:00100000:3.0:1787692498.244750:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125911168 00000100:00100000:3.0:1787692498.244856:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787692498.244864:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125911168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692498.244907:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125911168:12345-0@lo:400:kworker.0 Request processed in 45us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692498.244915:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787692498.245113:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92ec903b3b80 x1874531125911168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692514 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692498.245124:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125911168:0@lo:400:kworker.0 00010000:00010000:3.0:1787692498.692382:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692499.713314:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787692499.912449:0:15038:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787692499.912454:0:15038:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787692499.912569:0:15038:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92eb850d5800 00000020:01000004:1.0:1787692499.912588:0:15038:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787692499.912601:0:15038:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787692499.912784:0:15038:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff92ecb51699b8) 00000020:00000080:1.0:1787692499.912804:0:15038:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787692499.946980:0:15038:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787692499.947234:0:15038:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787692499.948388:0:15038:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787692499.948703:0:15038:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787692499.949081:0:15038:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787692499.949621:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 301: rc = 0 00100000:10000000:3.0:1787692499.949717:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 301: rc = 0 00100000:10000000:3.0:1787692499.950071:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 301: rc = 0 00100000:10000000:3.0:1787692499.950710:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 487: rc = 0 00100000:10000000:3.0:1787692499.951199:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 487: rc = 0 00100000:10000000:3.0:1787692499.951607:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 487: rc = 0 00100000:10000000:3.0:1787692499.952098:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 487: rc = 0 00100000:10000000:3.0:1787692499.952359:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 487: rc = 0 00100000:10000000:3.0:1787692499.952668:0:15038:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 487: rc = 0 00000020:00000080:3.0:1787692499.953610:0:15038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787692499.953621:0:15038:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787692499.953635:0:15038:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d8b8560a09df412 00000020:01000004:3.0:1787692499.953642:0:15038:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787692499.953663:0:15038:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.127@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787692499.953666:0:15038:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787692499.953673:0:15038:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787692499.953678:0:15038:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787692499.953689:0:15038:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff92ecaee5cd28) 00000020:00000080:3.0:1787692499.953700:0:15038:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787692499.955049:0:15038:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787692499.955233:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787692499.955239:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787692499.956289:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787692499.956297:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787692499.959068:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787692499.959087:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1787692499.961733:0:15038:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787692499.961951:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1787692499.961958:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787692499.963801:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787692499.963876:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787692499.991739:0:15038:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787692499.992225:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787692499.992238:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787692500.002019:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787692500.002041:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787692500.003554:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787692500.003567:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787692500.007269:0:15038:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787692500.008103:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787692500.008111:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787692500.009085:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787692500.009095:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787692500.055394:0:15038:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787692500.055592:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787692500.055598:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787692500.056798:0:15038:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787692500.056808:0:15038:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787692500.057589:0:15038:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787692500.057623:0:15038:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787692500.057629:0:15038:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.127@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787692500.081088:0:15038:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787692500.081126:0:15038:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.127@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787692500.081131:0:15038:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787692500.081132:0:15038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787692500.081134:0:15038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692500.081135:0:15038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692500.081136:0:15038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692500.081352:0:15038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692500.081354:0:15038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692500.081356:0:15038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692500.081357:0:15038:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787692500.081360:0:15038:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787692500.081363:0:15038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787692500.081364:0:15038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787692500.081365:0:15038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692500.081366:0:15038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692500.081367:0:15038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692500.081368:0:15038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692500.081369:0:15038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692500.081370:0:15038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692500.081371:0:15038:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787692500.081396:0:15038:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787692500.081413:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125911296:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787692500.081487:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.081543:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec87810f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787692500.083132:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125911296 00000100:00100000:2.0:1787692500.083145:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125911296 00000100:00100000:2.0:1787692500.083207:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787692500.083217:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec89c72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:15038:x1874531125911296:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787692500.083248:0:14349:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787692500.083251:0:14349:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787692500.083255:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787692500.099285:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec89c72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:15038:x1874531125911296:12345-0@lo:253:mount.lustre.0 Request processed in 16060us (17788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692500.099298:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787692500.099721:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125911296:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787692500.099736:0:15038:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787692500.099739:0:15038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787692500.099741:0:15038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787692500.099742:0:15038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692500.099755:0:15038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692500.099756:0:15038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692500.099758:0:15038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692500.099759:0:15038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787692500.099761:0:15038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692500.099762:0:15038:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787692500.099781:0:15038:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92eb850d5800 from lustre-OST0000 10000000:01000000:2.0:1787692500.099805:0:15038:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787692500.099808:0:15038:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787692500.099835:0:15038:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92eb85140000 local copy 00010000:00010000:2.0:1787692500.099845:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a2400/0x5d8b8560a09df308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df30f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692500.101204:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125911424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787692500.101264:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692500.101308:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a463c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692500.101396:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125911424 00000100:00100000:0.0:1787692500.101403:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125911424 00000100:00100000:0.0:1787692500.101456:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787692500.101464:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:15038:x1874531125911424:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787692500.101651:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:15038:x1874531125911424:12345-0@lo:501:mount.lustre.0 Request processed in 186us (386us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787692500.101658:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787692500.102200:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125911424:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787692500.102219:0:15038:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787692500.102384:0:15038:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787692500.102392:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a2400/0x5d8b8560a09df308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df30f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692500.102401:0:15038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec814a2400/0x5d8b8560a09df308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df30f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692500.102426:0:15038:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92eb850d5800 10000000:01000000:2.0:1787692500.102431:0:15038:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787692500.102435:0:15038:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff92eb85140000 10000000:01000000:2.0:1787692500.102438:0:15038:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787692500.102441:0:15038:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff92eb85140000 from 1 10000000:01000000:2.0:1787692500.102444:0:15038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787692500.102477:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a3e00/0x5d8b8560a09df420 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692500.102485:0:15038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec814a3e00/0x5d8b8560a09df420 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692500.102493:0:15038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec814a3e00/0x5d8b8560a09df420 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692500.102509:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125911552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787692500.102541:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692500.102578:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec88a463c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692500.102654:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125911552 00000100:00100000:3.0:1787692500.102659:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125911552 00000100:00100000:3.0:1787692500.102696:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787692500.102705:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+12:15038:x1874531125911552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787692500.102715:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692500.102728:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09df427 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df420 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.102747:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09df427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df420 expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.102754:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec8b35ba00/0x5d8b8560a09df427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df420 expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.102765:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35ba00, rc 0) 00000100:00100000:3.0:1787692500.103167:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+13:15038:x1874531125911552:12345-0@lo:101:mount.lustre.0 Request processed in 461us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692500.103177:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787692500.103441:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125911552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787692500.103460:0:15038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec814a3e00/0x5d8b8560a09df420 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df427 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.103469:0:15038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec814a3e00/0x5d8b8560a09df420 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df427 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692500.103485:0:15038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787692500.103538:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a3e00/0x5d8b8560a09df420 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df427 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.103545:0:15038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec814a3e00/0x5d8b8560a09df420 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df427 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692500.103552:0:15038:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787692500.103557:0:15038:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787692500.103562:0:15038:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787692500.103564:0:15038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787692500.103587:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ae00/0x5d8b8560a09df42e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.103594:0:15038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ae00/0x5d8b8560a09df42e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.103614:0:15038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ae00/0x5d8b8560a09df42e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692500.103628:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125911680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787692500.103659:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.103736:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90915840 going to sleep for 11 seconds 00000100:00100000:1.0:1787692500.103895:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125911680 00000100:00100000:1.0:1787692500.103900:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125911680 00000100:00100000:0.0:1787692500.104015:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787692500.104026:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+13:15038:x1874531125911680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787692500.104038:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692500.104050:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e1c00/0x5d8b8560a09df435 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df42e expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692500.104078:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e1c00/0x5d8b8560a09df435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df42e expref: 14 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692500.104087:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecbc2e1c00/0x5d8b8560a09df435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df42e expref: 14 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692500.104095:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1c00, rc 0) 00000100:00100000:0.0:1787692500.104191:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+14:15038:x1874531125911680:12345-0@lo:101:mount.lustre.0 Request processed in 166us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692500.104197:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787692500.107954:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125911680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787692500.107998:0:15038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ae00/0x5d8b8560a09df42e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df435 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.108012:0:15038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ae00/0x5d8b8560a09df42e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df435 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787692500.108741:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787692500.109513:0:15038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787692500.109738:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787692500.109776:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787692500.109802:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787692500.109899:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787692500.109937:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787692500.109983:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787692500.110041:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787692500.110049:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787692500.110118:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125911808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787692500.110173:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.110215:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec909150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692500.110237:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125911808 00000100:00100000:2.0:1787692500.110244:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125911808 00000100:00100000:2.0:1787692500.110429:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787692500.110440:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+14:15038:x1874531125911808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787692500.110955:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+14:15038:x1874531125911808:12345-0@lo:501:mount.lustre.0 Request processed in 516us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692500.110964:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787692500.111184:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125911808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787692500.111232:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125911936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787692500.111267:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.111285:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec909150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692500.111336:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125911936 00000100:00100000:0.0:1787692500.111341:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125911936 00000100:00100000:0.0:1787692500.111402:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787692500.111410:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+14:15038:x1874531125911936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787692500.111744:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+14:15038:x1874531125911936:12345-0@lo:503:mount.lustre.0 Request processed in 335us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692500.111751:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787692500.112392:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125911936:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787692500.114116:0:15038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787692500.114212:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787692500.114288:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.114336:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec909150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787692500.115139:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125912064 00000100:00100000:2.0:1787692500.115148:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125912064 00000100:00100000:2.0:1787692500.115205:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787692500.115215:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+14:15038:x1874531125912064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787692500.115531:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+14:15038:x1874531125912064:12345-0@lo:502:mount.lustre.0 Request processed in 317us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692500.115550:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787692500.116177:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787692500.116519:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787692500.119994:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787692500.120050:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787692500.120125:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787692500.120191:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787692500.120227:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787692500.120290:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787692500.120329:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787692500.120362:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1787692500.120409:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1787692500.120441:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1787692500.120486:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1787692500.120533:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787692500.122286:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.122346:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec909150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692500.122989:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125912192 00000100:00100000:1.0:1787692500.122998:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125912192 00000100:00100000:1.0:1787692500.123061:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787692500.123070:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+14:15038:x1874531125912192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787692500.123315:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+14:15038:x1874531125912192:12345-0@lo:502:mount.lustre.0 Request processed in 245us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692500.123324:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787692500.123570:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787692500.123678:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1787692500.123699:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1787692500.127557:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787692500.127569:0:15052:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787692500.127576:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692500.127579:0:15052:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787692500.127585:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787692500.127601:0:15052:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff92ecb5168000) 00000020:00000080:1.0:1787692500.127623:0:15052:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787692500.127630:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787692500.127703:0:15052:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92eb850d5800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787692500.127711:0:15052:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787692500.127719:0:15052:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5d8b8560a09df443 00010000:00010000:1.0:1787692500.133914:0:15052:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1787692500.134581:0:15052:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1787692500.138170:0:15052:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787692500.141545:0:15052:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787692500.141558:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692500.141564:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692500.141567:0:15052:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787692500.141570:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787692500.141573:0:15052:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1787692500.141591:0:15052:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787692500.141594:0:15052:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787692500.141596:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787692500.141599:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692500.141600:0:15052:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787692500.141603:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787692500.141606:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692500.141608:0:15052:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787692500.141611:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787692500.141613:0:15052:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787692500.141615:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692500.141617:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692500.141619:0:15052:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787692500.141621:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787692500.141623:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692500.141625:0:15052:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787692500.141628:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787692500.141684:0:15052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692500.141688:0:15052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692500.141690:0:15052:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787692500.141693:0:15052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787692500.142001:0:15038:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787692500.142030:0:15038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787692500.142055:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ae00/0x5d8b8560a09df42e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df435 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.142076:0:15038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec8b35ae00/0x5d8b8560a09df42e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df435 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692500.142085:0:15038:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92eb850d5800 from 1 10000000:01000000:3.0:1787692500.142087:0:15038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787692500.142122:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.142130:0:15038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.142141:0:15038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692500.142163:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787692500.142226:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.142271:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90915f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787692500.142502:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125912320 00000100:00100000:1.0:1787692500.142510:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125912320 00000100:00100000:1.0:1787692500.142555:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787692500.142565:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+14:15038:x1874531125912320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787692500.142578:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692500.142590:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec88164400/0x5d8b8560a09df451 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df44a expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692500.142612:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec88164400/0x5d8b8560a09df451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df44a expref: 15 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692500.142622:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec88164400/0x5d8b8560a09df451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df44a expref: 15 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692500.142640:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164400, rc 0) 00000100:00100000:1.0:1787692500.142688:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+15:15038:x1874531125912320:12345-0@lo:101:mount.lustre.0 Request processed in 124us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692500.142695:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787692500.142777:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787692500.142792:0:15038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df451 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.142842:0:15038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df451 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787692500.143576:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787692500.144306:0:15038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787692500.144619:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787692500.144662:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787692500.144718:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787692500.144726:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787692500.144790:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787692500.145479:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.149500:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90915f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787692500.153011:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125912448 00000100:00100000:0.0:1787692500.153025:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125912448 00000100:00100000:0.0:1787692500.153284:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787692500.153297:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+15:15038:x1874531125912448:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787692500.153708:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+15:15038:x1874531125912448:12345-0@lo:501:mount.lustre.0 Request processed in 413us (8647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692500.153718:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787692500.154194:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787692500.154251:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787692500.154306:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.154332:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90915f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787692500.154640:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125912576 00000100:00100000:0.0:1787692500.154645:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125912576 00000100:00100000:0.0:1787692500.154693:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787692500.154700:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+15:15038:x1874531125912576:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787692500.154882:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+15:15038:x1874531125912576:12345-0@lo:503:mount.lustre.0 Request processed in 182us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692500.154890:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787692500.155267:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912576:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787692500.155762:0:15038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787692500.155866:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787692500.155914:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.155948:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90915f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787692500.156194:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125912704 00000100:00100000:0.0:1787692500.156200:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125912704 00000100:00100000:0.0:1787692500.156238:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787692500.156245:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+15:15038:x1874531125912704:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787692500.156420:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+15:15038:x1874531125912704:12345-0@lo:502:mount.lustre.0 Request processed in 174us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692500.156427:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787692500.156630:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787692500.156901:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787692500.156948:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787692500.157203:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787692500.157247:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787692500.157287:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787692500.157340:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787692500.157389:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787692500.157509:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787692500.157547:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787692500.157599:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.157690:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90915f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787692500.158790:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125912832 00000100:00100000:0.0:1787692500.158808:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125912832 00000100:00100000:0.0:1787692500.158875:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787692500.158884:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+15:15038:x1874531125912832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787692500.159333:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+15:15038:x1874531125912832:12345-0@lo:502:mount.lustre.0 Request processed in 448us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692500.159341:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787692500.159450:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912832:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787692500.159577:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1787692500.159593:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787692500.161573:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787692500.161585:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692500.161587:0:15056:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787692500.161594:0:15056:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92eb850d5800 00000020:00000080:1.0:1787692500.161597:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787692500.161603:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692500.161606:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692500.161607:0:15056:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787692500.161610:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787692500.161612:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692500.161613:0:15056:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787692500.161617:0:15056:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92eb850d5800 00000020:00000080:1.0:1787692500.161619:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000040:00080000:0.0:1787692500.161792:0:14390:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787692500.161809:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787692500.161878:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1787692500.161884:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000000:1.0:1787692500.162055:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692500.162085:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692500.162087:0:15056:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787692500.162091:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787692500.162094:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692500.162095:0:15056:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787692500.162099:0:15056:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92eb850d5800 00000020:00000080:1.0:1787692500.162101:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787692500.167504:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692500.167517:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692500.167519:0:15056:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787692500.167523:0:15056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787692500.168859:0:15038:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787692500.168896:0:15038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787692500.168913:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df451 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692500.168936:0:15038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df451 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787692500.169004:0:15038:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787692500.169007:0:15038:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92eb850d5800 10000000:01000000:0.0:1787692500.169010:0:15038:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92eb850d5800 10000000:01000000:0.0:1787692500.169014:0:15038:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787692500.169019:0:15038:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92eb850d5800 from 1 10000000:01000000:0.0:1787692500.169022:0:15038:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787692500.169055:0:15038:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1000/0x5d8b8560a09df458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692500.169072:0:15038:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1000/0x5d8b8560a09df458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692500.169082:0:15038:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1000/0x5d8b8560a09df458 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692500.169105:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912960:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787692500.169183:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692500.169217:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9020c240 going to sleep for 11 seconds 00000100:00100000:1.0:1787692500.170371:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125912960 00000100:00100000:1.0:1787692500.170390:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125912960 00000100:00100000:1.0:1787692500.170436:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787692500.170446:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+15:15038:x1874531125912960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787692500.170461:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692500.170476:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec88165400/0x5d8b8560a09df45f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df458 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692500.170499:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec88165400/0x5d8b8560a09df45f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df458 expref: 16 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692500.170509:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec88165400/0x5d8b8560a09df45f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df458 expref: 16 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692500.170518:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165400, rc 0) 00000100:00100000:1.0:1787692500.170576:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15038:x1874531125912960:12345-0@lo:101:mount.lustre.0 Request processed in 132us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692500.170584:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787692500.171541:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125912960:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787692500.171566:0:15038:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1000/0x5d8b8560a09df458 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df45f expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692500.171577:0:15038:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1000/0x5d8b8560a09df458 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df45f expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787692500.173354:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787692500.178609:0:15038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787692500.180493:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787692500.180597:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787692500.180659:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787692500.180839:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787692500.180901:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787692500.181254:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787692500.181315:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787692500.181371:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787692500.181455:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787692500.181516:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787692500.181572:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787692500.181656:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787692500.181713:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787692500.181847:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787692500.181904:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787692500.181955:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787692500.182005:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787692500.182071:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787692500.182112:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787692500.182160:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787692500.182211:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787692500.182265:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787692500.182297:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787692500.182360:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787692500.182411:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787692500.182449:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787692500.182505:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787692500.182548:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787692500.182655:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787692500.182673:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787692500.183097:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125913088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787692500.183167:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692500.183349:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9020c240 going to sleep for 11 seconds 00000100:00100000:1.0:1787692500.183687:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125913088 00000100:00100000:1.0:1787692500.183695:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125913088 00000100:00100000:1.0:1787692500.183745:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787692500.183754:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15038:x1874531125913088:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787692500.184048:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15038:x1874531125913088:12345-0@lo:501:mount.lustre.0 Request processed in 294us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692500.184065:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787692500.184129:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125913088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787692500.184168:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125913216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787692500.184207:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692500.184245:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9020c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787692500.184368:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125913216 00000100:00100000:3.0:1787692500.184373:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125913216 00000100:00100000:3.0:1787692500.184471:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787692500.184508:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15038:x1874531125913216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787692500.184679:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15038:x1874531125913216:12345-0@lo:503:mount.lustre.0 Request processed in 199us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692500.184688:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787692500.184688:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125913216:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787692500.185891:0:15038:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787692500.185996:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125913344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787692500.186065:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.186104:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125913344 00000100:00100000:0.0:1787692500.186104:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9020c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787692500.186114:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125913344 00000100:00100000:3.0:1787692500.186163:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787692500.186172:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15038:x1874531125913344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787692500.186386:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15038:x1874531125913344:12345-0@lo:502:mount.lustre.0 Request processed in 215us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692500.186395:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787692500.186443:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125913344:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787692500.187236:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787692500.187313:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787692500.187359:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787692500.187428:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787692500.187479:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787692500.187560:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787692500.187607:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787692500.187651:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787692500.188127:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787692500.188175:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787692500.188210:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787692500.188285:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787692500.188339:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787692500.188406:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787692500.188492:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787692500.188559:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787692500.188597:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787692500.188653:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787692500.188696:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787692500.188905:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787692500.189131:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787692500.189190:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787692500.189230:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787692500.189299:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787692500.189346:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787692500.189409:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787692500.189507:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787692500.189578:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787692500.189619:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787692500.189692:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787692500.190425:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787692500.190473:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787692500.190521:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787692500.190579:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787692500.190626:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787692500.190681:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787692500.190889:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787692500.191046:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787692500.191113:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787692500.191167:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787692500.191220:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125913472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787692500.191298:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692500.191634:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9020c240 going to sleep for 11 seconds 00000100:00100000:3.0:1787692500.193282:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125913472 00000100:00100000:3.0:1787692500.193294:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125913472 00000100:00100000:0.0:1787692500.193411:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787692500.193421:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15038:x1874531125913472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787692500.193877:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15038:x1874531125913472:12345-0@lo:502:mount.lustre.0 Request processed in 455us (2578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692500.193884:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787692500.193901:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125913472:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787692500.194012:0:15038:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787692500.194026:0:15038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787692500.195708:0:15061:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787692500.195727:0:15061:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff92ecb516b370) 00000020:00000080:1.0:1787692500.195744:0:15061:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1787692500.195998:0:15061:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92eb850d5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787692500.196003:0:15061:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92eb850d5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787692500.196005:0:15061:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92eb850d5800 3 00010000:00080000:1.0:1787692500.196034:0:15061:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92eb850e1800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.127@tcp at head 00010000:00010000:1.0:1787692500.198253:0:15061:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1787692500.198489:0:15061:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787692500.198525:0:15061:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787692500.198537:0:15061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5d8b8560a09df46d 00000100:00080000:1.0:1787692500.198546:0:15061:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787692500.198551:0:15061:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92eb850e1800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1787692500.198582:0:15061:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecaf6f1880 x1874531125913600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787692500.198607:0:15061:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787692500.198633:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787692500.198637:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787692500.198640:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787692500.198643:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787692500.198700:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874531125913600:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787692500.198761:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692500.201130:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874531125913728:0@lo:400:kworker.0 00000100:00100000:0.0:1787692500.201534:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125913600 00000100:00100000:0.0:1787692500.201542:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125913600 00000100:00100000:0.0:1787692500.201597:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787692500.201605:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874531125913600:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787692500.201629:0:14356:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 406 last 0 00000020:00000080:0.0:1787692500.201664:0:14356:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5d8b8560a09df474 00000004:00100000:0.0:1787692500.201677:0:14356:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787692500.201704:0:14356:0:(import.c:65:import_set_state_nolock()) ffff92eb84d9a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787692500.201758:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874531125913600:12345-0@lo:38:llog_process_th.0 Request processed in 152us (2996us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692500.201766:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787692500.201790:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692500.201870:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125913728 00000100:00100000:0.0:1787692500.201875:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125913728 00000100:00100000:0.0:1787692500.201900:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787692500.201905:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874531125913728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692500.201941:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874531125913728:12345-0@lo:400:kworker.0 Request processed in 35us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692500.201948:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787692500.201991:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92ecaf6f0380 x1874531125913728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692500.202005:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874531125913728:0@lo:400:kworker.0 00010000:00080000:0.0:1787692500.202052:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff92ecaf6f1880 x1874531125913600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787692510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692500.202130:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787692500.202137:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787692500.202145:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787692500.202149:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787692500.202151:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92eb850e1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787692500.202157:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874531125913600:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1787692500.202528:0:15061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787692500.202666:0:15038:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787692500.202698:0:15038:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787692500.202717:0:15038:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1000/0x5d8b8560a09df458 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df45f expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.202731:0:15038:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1000/0x5d8b8560a09df458 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df45f expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787692500.202770:0:15038:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787692500.202772:0:15038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787692500.202774:0:15038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692500.202775:0:15038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692500.202776:0:15038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692500.202778:0:15038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692500.202780:0:15038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692500.202783:0:15038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692500.202784:0:15038:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787692500.202788:0:15038:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1787692500.202791:0:15038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787692500.202792:0:15038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787692500.202793:0:15038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692500.202794:0:15038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692500.202795:0:15038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692500.202797:0:15038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692500.202797:0:15038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692500.202799:0:15038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692500.202800:0:15038:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787692500.202845:0:15038:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787692500.202860:0:15038:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125913856:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787692500.202908:0:15038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.202936:0:15038:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90915000 going to sleep for 11 seconds 00000100:00100000:1.0:1787692500.203029:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125913856 00000100:00100000:1.0:1787692500.203035:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125913856 00000100:00100000:3.0:1787692500.203153:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787692500.203162:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15038:x1874531125913856:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787692500.203184:0:14350:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787692500.203199:0:14350:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787692500.243806:0:14350:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787692500.243917:0:14350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1787692500.244424:0:14372:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787692500.244429:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787692500.244450:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.244467:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec8b35a400/0x5d8b8560a09df3e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df3e1 expref: 16 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.244475:0:14372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.244571:0:14372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec8b35a400/0x5d8b8560a09df3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09df3e1 expref: 16 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.244584:0:14372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ec8b35a400/0x5d8b8560a09df3e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09df3e1 expref: 16 pid: 14349 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692500.244678:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1874531125913984:0@lo:104: 00000100:00100000:3.0:1787692500.244733:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.244859:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec83c12840 going to sleep for 11 seconds 00000100:00100000:2.0:1787692500.245006:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125913984 00000100:00100000:2.0:1787692500.245013:0:14340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125913984 00000100:00100000:2.0:1787692500.245128:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787692500.245137:0:14340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25c21df9-20cc-4624-87d0-9b55ad554e5c+3:14372:x1874531125913984:12345-0@lo:104: 00010000:00010000:2.0:1787692500.245148:0:14340:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df3e8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692500.245198:0:14340:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787692500.245203:0:14340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:25c21df9-20cc-4624-87d0-9b55ad554e5c+3:14372:x1874531125913984:12345-0@lo:104: Request processed in 68us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692500.245210:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787692500.245279:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1874531125913984:0@lo:104: 00010000:00010000:0.0:1787692500.245296:0:14372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245344:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692500.245350:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df3e8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245357:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1200 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:3.0:1787692500.245361:0:14344:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09df3e8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245369:0:14344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09df3e8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787692500.245377:0:14344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09df3e8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692500.245388:0:14344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787692500.245445:0:14344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df3e8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245452:0:14344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787692500.245475:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df3e8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245482:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ecbc2e1200/0x5d8b8560a09df3e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df3e8 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245496:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692500.245498:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692500.245499:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692500.245505:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787692500.245515:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125914112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787692500.245540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692500.245580:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125914112 00000100:00100000:3.0:1787692500.245584:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125914112 00010000:00010000:3.0:1787692500.245609:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec8b35a400/0x5d8b8560a09df3e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df3e1 expref: 17 pid: 14349 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692500.245628:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787692500.245634:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf686d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:3304:x1874531125914112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692500.245643:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692500.245647:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec8b35a400/0x5d8b8560a09df3e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df3e1 expref: 17 pid: 14349 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245657:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec8b35a400/0x5d8b8560a09df3e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09df3e1 expref: 17 pid: 14349 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245675:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec8b35a400/0x5d8b8560a09df3e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09df3e1 expref: 17 pid: 14349 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245686:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245694:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787692500.245704:0:14343:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001275610s 00010000:00010000:3.0:1787692500.245708:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245715:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245722:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245728:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245733:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b800 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692500.245737:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245753:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245765:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245777:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692500.245802:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf686d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:3304:x1874531125914112:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692500.245808:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787692500.245867:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125914112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692500.245883:0:14372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245889:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692500.245896:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec8b35b800/0x5d8b8560a09df47b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692500.252610:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+15:15038:x1874531125913856:12345-0@lo:253:mount.lustre.0 Request processed in 49432us (49684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692500.252623:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787692500.252963:0:15038:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15038:1874531125913856:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787692500.252998:0:15038:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787692500.253002:0:15038:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787692500.253004:0:15038:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787692500.253005:0:15038:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787692500.253007:0:15038:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787692500.253008:0:15038:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787692500.253009:0:15038:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787692500.253011:0:15038:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787692500.253013:0:15038:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787692500.253014:0:15038:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787692500.253039:0:15038:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787692500.260078:0:15038:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692500.260272:0:15038:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787692500.260444:0:15038:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692500.262031:0:15038:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787692500.262226:0:15038:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692500.262497:0:15038:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787692500.264049:0:15038:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787692500.326580:0:15038:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787692500.326600:0:15038:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787692500.326636:0:15038:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787692500.326689:0:15038:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.127@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787692500.326704:0:15038:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787692500.326733:0:15038:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787692500.738394:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787692501.313783:0:14354:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787692501.313791:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92ec88172800 from 7 10000000:01000000:2.0:1787692501.313795:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787692501.313873:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692501.313886:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692501.313897:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692501.313921:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125914240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787692501.313996:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692501.314038:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb22aa840 going to sleep for 11 seconds 00000100:00100000:0.0:1787692501.314213:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125914240 00000100:00100000:0.0:1787692501.314221:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125914240 00000100:00100000:0.0:1787692501.314329:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787692501.314338:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+15:14354:x1874531125914240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692501.314352:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692501.314365:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e1e00/0x5d8b8560a09df489 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df482 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692501.314387:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e1e00/0x5d8b8560a09df489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df482 expref: 16 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692501.314397:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecbc2e1e00/0x5d8b8560a09df489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df482 expref: 16 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692501.314422:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1e00, rc 0) 00000100:00100000:0.0:1787692501.314467:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:14354:x1874531125914240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692501.314474:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787692501.314560:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125914240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787692501.314574:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df489 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692501.314582:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df489 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692501.314639:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125914368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787692501.314669:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692501.315959:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb22aa840 going to sleep for 11 seconds 00000100:00100000:3.0:1787692501.316081:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125914368 00000100:00100000:3.0:1787692501.316091:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125914368 00000100:00100000:3.0:1787692501.316134:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787692501.316143:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:14354:x1874531125914368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787692501.316165:0:14351:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787692501.316185:0:14351:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787692501.316188:0:14351:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787692501.316297:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:14354:x1874531125914368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 155us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692501.316306:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787692501.316792:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125914368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787692501.316889:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787692501.316899:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df489 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692501.316909:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df489 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692501.765253:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692502.785336:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692503.809250:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692504.836515:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787692505.328585:0:15404:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787692505.409650:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787692505.409656:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787692505.409659:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787692505.409662:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787692505.409711:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125914752:0@lo:400:kworker.0 00000100:00100000:2.0:1787692505.409786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692505.409880:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25c21df9-20cc-4624-87d0-9b55ad554e5c:3306:1874531125914496:0@lo:400:kworker.0 00000100:00100000:2.0:1787692505.409896:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125914752 00000100:00100000:2.0:1787692505.409903:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125914752 00000100:00100000:0.0:1787692505.409934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692505.409974:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692505.409981:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125914624:0@lo:400:kworker.0 00000100:00100000:0.0:1787692505.410026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692505.410058:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125914496 00000100:00100000:0.0:1787692505.410062:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125914496 00000100:00100000:0.0:1787692505.410108:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787692505.410118:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:3306:x1874531125914496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692505.410169:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:3306:x1874531125914496:12345-0@lo:400:kworker.0 Request processed in 53us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692505.410177:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787692505.410209:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125914624 00000100:00100000:0.0:1787692505.410213:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125914624 00000100:00100000:0.0:1787692505.410237:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787692505.410245:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125914624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692505.410276:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125914624:12345-0@lo:400:kworker.0 Request processed in 32us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692505.410282:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787692505.410344:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec903b1180 x1874531125914624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692505.410359:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125914624:0@lo:400:kworker.0 00000100:00100000:1.0:1787692505.410368:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25c21df9-20cc-4624-87d0-9b55ad554e5c:3306:1874531125914496:0@lo:400:kworker.0 00000100:00100000:2.0:1787692505.410471:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787692505.410479:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125914752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692505.410516:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125914752:12345-0@lo:400:kworker.0 Request processed in 39us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692505.410529:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787692505.410917:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787692505.414310:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ec903b0380 x1874531125914752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692505.414329:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125914752:0@lo:400:kworker.0 00010000:00010000:0.0:1787692505.856975:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692506.882475:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692507.916105:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692508.932131:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692509.953062:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787692510.401090:0:14390:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787692510.401099:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787692510.401678:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1787692510.401751:0:14390:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787692510.401784:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00080000:1.0:1787692510.529514:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787692510.529520:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787692510.529523:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787692510.529525:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787692510.529570:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125915008:0@lo:400:kworker.0 00000100:00100000:1.0:1787692510.529631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692510.529684:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787692510.529691:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125915136:0@lo:400:kworker.0 00000100:00100000:1.0:1787692510.529718:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692510.529762:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125915008 00000100:00100000:1.0:1787692510.529769:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125915008 00000100:00100000:1.0:1787692510.529803:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125915136 00000100:00100000:1.0:1787692510.529806:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125915136 00000100:00100000:1.0:1787692510.529893:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787692510.529901:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125915008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692510.529958:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125915008:12345-0@lo:400:kworker.0 Request processed in 57us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692510.529972:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787692510.529986:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787692510.529992:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125915136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692510.530020:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125915136:12345-0@lo:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692510.530026:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787692510.530052:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787692510.530075:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecaf6f3480 x1874531125915136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692510.530088:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125915136:0@lo:400:kworker.0 00010000:00080000:1.0:1787692510.530098:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecaf6f1c00 x1874531125915008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692510.530106:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125915008:0@lo:400:kworker.0 00000100:00100000:0.0:1787692510.530715:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787692510.530729:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125914880:0@lo:400:kworker.0 00000100:00100000:0.0:1787692510.530771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692510.531169:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125914880 00000100:00100000:1.0:1787692510.531175:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125914880 00000100:00100000:1.0:1787692510.531209:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787692510.531216:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:3304:x1874531125914880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692510.531260:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:3304:x1874531125914880:12345-0@lo:400:kworker.0 Request processed in 42us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692510.531266:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787692510.531551:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125914880:0@lo:400:kworker.0 00010000:00010000:3.0:1787692510.977410:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787692511.335489:0:15755:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787692511.335494:0:15755:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787692511.335605:0:15755:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff92ec984de000 00000020:01000004:3.0:1787692511.335620:0:15755:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787692511.335632:0:15755:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787692511.335645:0:15755:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff92ecaee5b370) 00000020:00000080:3.0:1787692511.335660:0:15755:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787692511.355415:0:15755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787692511.355704:0:15755:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787692511.357080:0:15755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787692511.357551:0:15755:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787692511.357771:0:15755:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787692511.358503:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 497: rc = 0 00100000:10000000:3.0:1787692511.358631:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 497: rc = 0 00100000:10000000:3.0:1787692511.358723:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 497: rc = 0 00100000:10000000:3.0:1787692511.359651:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 641: rc = 0 00100000:10000000:3.0:1787692511.360085:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 641: rc = 0 00100000:10000000:3.0:1787692511.360717:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 641: rc = 0 00100000:10000000:2.0:1787692511.361408:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 641: rc = 0 00100000:10000000:2.0:1787692511.361669:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 641: rc = 0 00100000:10000000:2.0:1787692511.361968:0:15755:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 641: rc = 0 00000020:00000080:2.0:1787692511.362503:0:15755:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787692511.362515:0:15755:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787692511.362526:0:15755:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d8b8560a09df497 00000020:01000004:2.0:1787692511.362533:0:15755:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787692511.362553:0:15755:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.127@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787692511.362556:0:15755:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.127@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787692511.362853:0:15755:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787692511.362876:0:15755:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787692511.362880:0:15755:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.127@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787692511.374644:0:15755:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.127@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787692511.374681:0:15755:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.127@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1787692511.374685:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787692511.374687:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787692511.374689:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692511.374690:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692511.374691:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692511.374692:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692511.374694:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787692511.374696:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692511.374697:0:15755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787692511.374700:0:15755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1787692511.374703:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787692511.374704:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787692511.374705:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692511.374706:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692511.374707:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692511.374708:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692511.374714:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787692511.374716:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692511.374717:0:15755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787692511.374746:0:15755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787692511.374767:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125915264:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787692511.375263:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692511.375480:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9020c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787692511.375524:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125915264 00000100:00100000:0.0:1787692511.375532:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125915264 00000100:00100000:0.0:1787692511.375585:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787692511.375594:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15755:x1874531125915264:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787692511.375627:0:14351:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787692511.375630:0:14351:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787692511.375634:0:14351:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787692511.396833:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15755:x1874531125915264:12345-0@lo:253:mount.lustre.0 Request processed in 21213us (21545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692511.396848:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787692511.397068:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125915264:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787692511.397084:0:15755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787692511.397087:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787692511.397089:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787692511.397090:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692511.397091:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692511.397092:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692511.397094:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692511.397095:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787692511.397097:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692511.397098:0:15755:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787692511.397368:0:15755:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92ec984de000 from lustre-OST0001 10000000:01000000:2.0:1787692511.397396:0:15755:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787692511.397399:0:15755:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787692511.397406:0:15755:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff92eb85140000 local copy 00010000:00010000:2.0:1787692511.397415:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a2400/0x5d8b8560a09df308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df30f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692511.397643:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125915392:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787692511.397692:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692511.397788:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec87f49600 going to sleep for 11 seconds 00000100:00100000:1.0:1787692511.399090:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125915392 00000100:00100000:1.0:1787692511.399101:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125915392 00000100:00100000:1.0:1787692511.399162:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787692511.399182:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15755:x1874531125915392:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787692511.399797:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15755:x1874531125915392:12345-0@lo:501:mount.lustre.0 Request processed in 615us (2104us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787692511.399806:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787692511.400210:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125915392:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787692511.400235:0:15755:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.127@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787692511.400427:0:15755:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.127@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787692511.400436:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a2400/0x5d8b8560a09df308 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df30f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.400447:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec814a2400/0x5d8b8560a09df308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df30f expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692511.400629:0:15755:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92ec984de000 10000000:01000000:3.0:1787692511.400634:0:15755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787692511.400640:0:15755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787692511.400643:0:15755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787692511.400647:0:15755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1787692511.400650:0:15755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787692511.400681:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df49e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.400689:0:15755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df49e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.400708:0:15755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df49e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692511.400726:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125915520:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787692511.400773:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692511.401070:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8787ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692511.401141:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125915520 00000100:00100000:1.0:1787692511.401147:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125915520 00000100:00100000:1.0:1787692511.401229:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787692511.401238:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:15755:x1874531125915520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787692511.401249:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692511.401262:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09df4a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df49e expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692511.401294:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09df4a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df49e expref: 17 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692511.401304:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec88165c00/0x5d8b8560a09df4a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df49e expref: 17 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692511.401312:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165c00, rc 0) 00000100:00100000:1.0:1787692511.401357:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:15755:x1874531125915520:12345-0@lo:101:mount.lustre.0 Request processed in 120us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692511.401364:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787692511.401432:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125915520:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787692511.401445:0:15755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df49e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df4a5 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.401454:0:15755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df49e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df4a5 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787692511.402128:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787692511.402988:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787692511.403220:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787692511.403263:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787692511.403296:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787692511.403342:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787692511.403379:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787692511.403410:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787692511.403471:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787692511.403479:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787692511.403551:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125915648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787692511.403610:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692511.404161:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8787c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787692511.404358:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125915648 00000100:00100000:2.0:1787692511.404364:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125915648 00000100:00100000:2.0:1787692511.404405:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787692511.404414:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:15755:x1874531125915648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787692511.405006:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:15755:x1874531125915648:12345-0@lo:501:mount.lustre.0 Request processed in 591us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692511.405014:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787692511.405134:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125915648:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787692511.405180:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125915776:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787692511.405361:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692511.405394:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8787c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787692511.405456:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125915776 00000100:00100000:1.0:1787692511.405461:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125915776 00000100:00100000:1.0:1787692511.405497:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787692511.405505:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:15755:x1874531125915776:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787692511.405886:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:15755:x1874531125915776:12345-0@lo:503:mount.lustre.0 Request processed in 381us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692511.405900:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787692511.406358:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125915776:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787692511.407114:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787692511.407254:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125915904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787692511.407379:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692511.407468:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8787c840 going to sleep for 11 seconds 00000100:00100000:2.0:1787692511.407514:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125915904 00000100:00100000:2.0:1787692511.407521:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125915904 00000100:00100000:2.0:1787692511.407609:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787692511.407619:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:15755:x1874531125915904:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787692511.407870:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:15755:x1874531125915904:12345-0@lo:502:mount.lustre.0 Request processed in 243us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692511.407886:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787692511.408064:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125915904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787692511.408306:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1787692511.408357:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1787692511.408396:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1787692511.408449:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1787692511.408502:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1787692511.408539:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1787692511.408592:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1787692511.408630:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1787692511.408681:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1787692511.408714:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916032:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787692511.408760:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692511.410423:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8787c840 going to sleep for 11 seconds 00000100:00100000:1.0:1787692511.410593:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125916032 00000100:00100000:1.0:1787692511.410601:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125916032 00000100:00100000:1.0:1787692511.410647:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787692511.410655:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:15755:x1874531125916032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787692511.411236:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:15755:x1874531125916032:12345-0@lo:502:mount.lustre.0 Request processed in 580us (2473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692511.411245:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787692511.411557:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916032:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787692511.411661:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1787692511.411675:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1787692511.412771:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787692511.412780:0:15756:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1787692511.412786:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787692511.412788:0:15756:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1787692511.412794:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787692511.412808:0:15756:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff92ecb4d48000) 00000020:00000080:3.0:1787692511.413105:0:15756:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787692511.413113:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787692511.413180:0:15756:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92ec984de000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787692511.413256:0:15756:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787692511.413265:0:15756:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5d8b8560a09df4b3 00010000:00010000:3.0:1787692511.417846:0:15756:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787692511.418516:0:15756:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1787692511.420722:0:15756:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787692511.422440:0:15756:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787692511.422453:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692511.422459:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692511.422462:0:15756:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787692511.422465:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787692511.422468:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692511.422470:0:15756:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787692511.422473:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787692511.422475:0:15756:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787692511.422478:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692511.422480:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692511.422481:0:15756:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787692511.422483:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787692511.422486:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692511.422487:0:15756:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787692511.422490:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787692511.422540:0:15756:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787692511.422543:0:15756:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787692511.422545:0:15756:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787692511.422548:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787692511.422793:0:15755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787692511.422854:0:15755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787692511.422877:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df49e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df4a5 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.422889:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b800/0x5d8b8560a09df49e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df4a5 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692511.422897:0:15755:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ec984de000 from 1 10000000:01000000:3.0:1787692511.422900:0:15755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787692511.423067:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.423075:0:15755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.423086:0:15755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692511.423120:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787692511.423183:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692511.423212:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8787cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787692511.423339:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125916160 00000100:00100000:1.0:1787692511.423347:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125916160 00000100:00100000:1.0:1787692511.423401:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787692511.423410:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84de4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:15755:x1874531125916160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787692511.423422:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692511.423433:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec88164a00/0x5d8b8560a09df4c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df4ba expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692511.423454:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec88164a00/0x5d8b8560a09df4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df4ba expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692511.423464:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec88164a00/0x5d8b8560a09df4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df4ba expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692511.423473:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164a00, rc 0) 00000100:00100000:1.0:1787692511.423518:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84de4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:15755:x1874531125916160:12345-0@lo:101:mount.lustre.0 Request processed in 109us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692511.423526:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787692511.423637:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787692511.423652:0:15755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df4c1 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.423667:0:15755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df4c1 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787692511.424273:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787692511.424554:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787692511.424756:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787692511.424793:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787692511.424938:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787692511.424947:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787692511.425004:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787692511.425049:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692511.425077:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8787cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787692511.426034:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125916288 00000100:00100000:2.0:1787692511.426042:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125916288 00000100:00100000:2.0:1787692511.426085:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787692511.426094:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84de5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:15755:x1874531125916288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787692511.426588:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84de5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:15755:x1874531125916288:12345-0@lo:501:mount.lustre.0 Request processed in 493us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692511.426597:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787692511.426765:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787692511.426806:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916416:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787692511.426875:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692511.426915:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8787cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787692511.427139:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125916416 00000100:00100000:2.0:1787692511.427145:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125916416 00000100:00100000:2.0:1787692511.427181:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787692511.427261:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84de6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:15755:x1874531125916416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787692511.427694:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84de6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:15755:x1874531125916416:12345-0@lo:503:mount.lustre.0 Request processed in 505us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692511.427702:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787692511.427881:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916416:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787692511.428369:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787692511.428431:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787692511.428471:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692511.428499:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8787cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787692511.428505:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125916544 00000100:00100000:2.0:1787692511.428510:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125916544 00000100:00100000:2.0:1787692511.428541:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787692511.428548:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84de4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:15755:x1874531125916544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787692511.428725:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84de4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:15755:x1874531125916544:12345-0@lo:502:mount.lustre.0 Request processed in 177us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692511.428732:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787692511.428749:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787692511.429008:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1787692511.429054:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1787692511.429197:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1787692511.429248:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1787692511.429284:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1787692511.429333:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1787692511.429976:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1787692511.430019:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1787692511.430053:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787692511.430168:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692511.430196:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec8787cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787692511.430592:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125916672 00000100:00100000:2.0:1787692511.430599:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125916672 00000100:00100000:2.0:1787692511.430641:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787692511.430649:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb850dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:15755:x1874531125916672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787692511.430849:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb850dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:15755:x1874531125916672:12345-0@lo:502:mount.lustre.0 Request processed in 199us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692511.430857:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787692511.430879:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787692511.430991:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787692511.431002:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787692511.434163:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787692511.434175:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692511.434177:0:15760:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787692511.434184:0:15760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ec984de000 00000020:00000080:3.0:1787692511.434186:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787692511.434193:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787692511.434196:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692511.434197:0:15760:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787692511.434200:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787692511.434202:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692511.434203:0:15760:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787692511.434206:0:15760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff92ec984de000 00000020:00000080:3.0:1787692511.434208:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787692511.434306:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787692511.434310:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692511.434312:0:15760:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787692511.434314:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787692511.434317:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692511.434318:0:15760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787692511.434322:0:15760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff92ec984de000 00000020:00000080:3.0:1787692511.434324:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787692511.435083:0:15760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787692511.435090:0:15760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787692511.435091:0:15760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787692511.435095:0:15760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787692511.435329:0:15755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787692511.435404:0:15755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787692511.435466:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df4c1 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692511.435478:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df4c1 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692511.435522:0:15755:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787692511.435524:0:15755:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92ec984de000 10000000:01000000:1.0:1787692511.435527:0:15755:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92ec984de000 10000000:01000000:1.0:1787692511.435530:0:15755:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787692511.435535:0:15755:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff92ec984de000 from 1 10000000:01000000:1.0:1787692511.435538:0:15755:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787692511.435575:0:15755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88165600/0x5d8b8560a09df4c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692511.435584:0:15755:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec88165600/0x5d8b8560a09df4c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692511.435594:0:15755:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec88165600/0x5d8b8560a09df4c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692511.435615:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916800:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787692511.435676:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692511.435721:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90400300 going to sleep for 11 seconds 00000100:00100000:3.0:1787692511.435803:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125916800 00000100:00100000:3.0:1787692511.435831:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125916800 00000100:00100000:3.0:1787692511.435872:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787692511.435881:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:15755:x1874531125916800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787692511.435893:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692511.435905:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df4cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df4c8 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.435937:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df4cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df4c8 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.435947:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec8b35be00/0x5d8b8560a09df4cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df4c8 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.435955:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35be00, rc 0) 00000100:00100000:3.0:1787692511.435993:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:15755:x1874531125916800:12345-0@lo:101:mount.lustre.0 Request processed in 113us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692511.436000:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787692511.436091:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787692511.436117:0:15755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec88165600/0x5d8b8560a09df4c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df4cf expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692511.436126:0:15755:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec88165600/0x5d8b8560a09df4c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df4cf expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787692511.436681:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787692511.438771:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787692511.439503:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787692511.439563:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787692511.439598:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787692511.439650:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787692511.439696:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787692511.439754:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787692511.439806:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787692511.439923:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787692511.443751:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787692511.443837:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787692511.443880:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787692511.443952:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787692511.443997:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787692511.444045:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787692511.444186:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787692511.444237:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787692511.444301:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787692511.444468:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787692511.444532:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787692511.444598:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787692511.444686:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787692511.444728:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787692511.444762:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787692511.444887:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787692511.444951:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787692511.444999:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787692511.445073:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787692511.445150:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787692511.445207:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787692511.445270:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787692511.445317:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787692511.445375:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787692511.445419:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787692511.445490:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787692511.445525:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787692511.445575:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787692511.445613:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787692511.445746:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787692511.445762:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787692511.445882:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787692511.445957:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692511.446015:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90400300 going to sleep for 11 seconds 00000100:00100000:2.0:1787692511.447480:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125916928 00000100:00100000:2.0:1787692511.447490:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125916928 00000100:00100000:2.0:1787692511.447547:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787692511.447558:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:15755:x1874531125916928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787692511.447870:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:15755:x1874531125916928:12345-0@lo:501:mount.lustre.0 Request processed in 313us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692511.447880:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787692511.448528:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125916928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787692511.448581:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125917056:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787692511.448634:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692511.448669:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125917056 00000100:00100000:1.0:1787692511.448673:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125917056 00000100:00100000:1.0:1787692511.448707:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787692511.448714:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:15755:x1874531125917056:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787692511.448978:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:15755:x1874531125917056:12345-0@lo:503:mount.lustre.0 Request processed in 264us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692511.448985:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787692511.449031:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90400300 going to sleep for 11 seconds 00000100:00100000:1.0:1787692511.449044:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125917056:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787692511.449634:0:15755:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787692511.449708:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125917184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787692511.449753:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692511.449772:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90400300 going to sleep for 11 seconds 00000100:00100000:2.0:1787692511.450086:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125917184 00000100:00100000:2.0:1787692511.450092:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125917184 00000100:00100000:2.0:1787692511.450142:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787692511.450151:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:15755:x1874531125917184:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787692511.450491:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:15755:x1874531125917184:12345-0@lo:502:mount.lustre.0 Request processed in 341us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692511.450498:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787692511.451021:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125917184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787692511.451461:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787692511.451521:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787692511.451559:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787692511.451618:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787692511.451678:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787692511.451736:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787692511.451793:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787692511.451891:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787692511.452012:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787692511.452078:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787692511.452115:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787692511.452176:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787692511.452226:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787692511.452283:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787692511.454731:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787692511.454868:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787692511.454947:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787692511.455062:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787692511.455132:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787692511.455206:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787692511.455289:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787692511.455350:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787692511.455419:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787692511.455476:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787692511.455570:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787692511.455648:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787692511.455729:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787692511.455795:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787692511.455855:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787692511.455940:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787692511.455998:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787692511.456046:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787692511.456089:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787692511.459521:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787692511.459627:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787692511.459694:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787692511.459732:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787692511.459766:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787692511.459833:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787692511.459874:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787692511.459937:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125917312:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787692511.460027:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692511.460079:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90400300 going to sleep for 11 seconds 00000100:00100000:2.0:1787692511.460466:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125917312 00000100:00100000:2.0:1787692511.460474:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125917312 00000100:00100000:2.0:1787692511.460537:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787692511.460548:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:15755:x1874531125917312:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787692511.460799:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:15755:x1874531125917312:12345-0@lo:502:mount.lustre.0 Request processed in 252us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692511.460808:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787692511.463464:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125917312:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787692511.463614:0:15755:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787692511.463630:0:15755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1787692511.467922:0:15764:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787692511.467939:0:15764:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff92ecb516cd28) 00000020:00000080:1.0:1787692511.467961:0:15764:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787692511.468034:0:15764:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92ec984de000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787692511.468039:0:15764:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92ec984de000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787692511.468041:0:15764:0:(obd_mount.c:710:lustre_put_lsi()) put ffff92ec984de000 3 00010000:00080000:1.0:1787692511.468074:0:15764:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92eb86b1e000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.127@tcp at head 00010000:00010000:1.0:1787692511.469722:0:15764:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787692511.469978:0:15764:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787692511.470013:0:15764:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787692511.470026:0:15764:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5d8b8560a09df4dd 00000100:00080000:1.0:1787692511.470036:0:15764:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787692511.470041:0:15764:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff92eb86b1e000 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:1.0:1787692511.470073:0:15764:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecaf6f0e00 x1874531125917440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787692511.470100:0:15764:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787692511.470246:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874531125917440:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787692511.470320:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787692511.470536:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787692511.470541:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787692511.470544:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787692511.470552:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787692511.470664:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874531125917568:0@lo:400:kworker.0 00000100:00100000:2.0:1787692511.470703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692511.470735:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787692511.470743:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125917696:0@lo:400:kworker.0 00000100:00100000:2.0:1787692511.470770:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692511.470804:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125917440 00000100:00100000:2.0:1787692511.470838:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125917440 00000100:00100000:2.0:1787692511.470865:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125917568 00000100:00100000:2.0:1787692511.470868:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125917568 00000100:00100000:2.0:1787692511.470892:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125917696 00000100:00100000:2.0:1787692511.470895:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125917696 00000100:00100000:2.0:1787692511.470923:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787692511.470932:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874531125917568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692511.470992:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874531125917568:12345-0@lo:400:kworker.0 Request processed in 62us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692511.471000:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787692511.471018:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787692511.471025:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125917696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692511.471057:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125917696:12345-0@lo:400:kworker.0 Request processed in 33us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692511.471063:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787692511.471077:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787692511.471081:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1874531125917440:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787692511.471101:0:14357:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:2.0:1787692511.471153:0:14357:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5d8b8560a09df4e4 00000004:00100000:2.0:1787692511.471166:0:14357:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787692511.471205:0:14357:0:(import.c:65:import_set_state_nolock()) ffff92ecaf646000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787692511.471246:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874531125917440:12345-0@lo:38:llog_process_th.0 Request processed in 163us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692511.471253:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787692511.471290:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecaf685500 x1874531125917696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692511.471309:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125917696:0@lo:400:kworker.0 00010000:00080000:2.0:1787692511.471321:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecaf684a80 x1874531125917568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692527 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692511.471329:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874531125917568:0@lo:400:kworker.0 00010000:00080000:2.0:1787692511.471363:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff92ecaf6f0e00 x1874531125917440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787692521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692511.471378:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787692511.471385:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787692511.471393:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787692511.471397:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787692511.471400:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92eb86b1e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787692511.471405:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874531125917440:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1787692511.472142:0:15764:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787692511.472332:0:15755:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787692511.472369:0:15755:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787692511.472393:0:15755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88165600/0x5d8b8560a09df4c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df4cf expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692511.472404:0:15755:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec88165600/0x5d8b8560a09df4c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df4cf expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787692511.472448:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787692511.472451:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787692511.472452:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692511.472453:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692511.472455:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692511.472456:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692511.472457:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787692511.472459:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692511.472461:0:15755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787692511.472464:0:15755:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787692511.472467:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787692511.472468:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787692511.472469:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692511.472470:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692511.472471:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692511.472472:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692511.472473:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787692511.472480:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692511.472481:0:15755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787692511.472500:0:15755:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787692511.472514:0:15755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125917824:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787692511.472567:0:15755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692511.472593:0:15755:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec94232780 going to sleep for 11 seconds 00000100:00100000:1.0:1787692511.472687:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125917824 00000100:00100000:1.0:1787692511.472694:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125917824 00000100:00100000:1.0:1787692511.472730:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787692511.472738:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:15755:x1874531125917824:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787692511.472759:0:14349:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787692511.472780:0:14349:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787692511.513794:0:14349:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787692511.513832:0:14349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787692511.513924:0:14372:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787692511.513929:0:14372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787692511.513949:0:14372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692511.513966:0:14372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ecbc2e1e00/0x5d8b8560a09df489 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df482 expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692511.513989:0:14372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692511.514027:0:14372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ecbc2e1e00/0x5d8b8560a09df489 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09df482 expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692511.514040:0:14372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ecbc2e1e00/0x5d8b8560a09df489 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09df482 expref: 19 pid: 14349 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692511.514054:0:14372:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1874531125917952:0@lo:104: 00000100:00100000:0.0:1787692511.514114:0:14372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692511.514154:0:14372:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecbbf49c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787692511.514309:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125917952 00000100:00100000:3.0:1787692511.514317:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125917952 00000100:00100000:3.0:1787692511.514363:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787692511.514371:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+3:14372:x1874531125917952:12345-0@lo:104: 00010000:00010000:3.0:1787692511.514383:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df489 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514444:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787692511.514450:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+3:14372:x1874531125917952:12345-0@lo:104: Request processed in 80us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692511.514457:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787692511.514474:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692511.514480:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df489 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514487:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:3.0:1787692511.514490:0:14344:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09df489 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514498:0:14344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09df489 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787692511.514504:0:14344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09df489 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692511.514510:0:14344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787692511.514534:0:14344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df489 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514540:0:14344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787692511.514558:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df489 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514564:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec814a3200/0x5d8b8560a09df482 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df489 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514589:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692511.514591:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692511.514593:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692511.514609:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25c21df9-20cc-4624-87d0-9b55ad554e5c:3306:1874531125918080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787692511.514636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692511.514664:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125918080 00000100:00100000:3.0:1787692511.514668:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125918080 00010000:00010000:3.0:1787692511.514681:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ecbc2e1e00/0x5d8b8560a09df489 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df482 expref: 20 pid: 14349 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692511.514699:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787692511.514704:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25c21df9-20cc-4624-87d0-9b55ad554e5c+20:3306:x1874531125918080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692511.514713:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692511.514718:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ecbc2e1e00/0x5d8b8560a09df489 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df482 expref: 20 pid: 14349 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514727:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ecbc2e1e00/0x5d8b8560a09df489 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09df482 expref: 20 pid: 14349 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514741:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514748:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787692511.514759:0:14343:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001275610s 00010000:00010000:3.0:1787692511.514763:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514778:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514786:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514791:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514796:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0c00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692511.514801:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514808:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514843:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692511.514852:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787692511.514991:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecbc2e1e00/0x5d8b8560a09df489 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09df482 expref: 20 pid: 14349 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692511.515002:0:14372:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14372:1874531125917952:0@lo:104: 00010000:00010000:1.0:1787692511.515017:0:14372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692511.515024:0:14372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692511.515029:0:14372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692511.515035:0:14372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df4eb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692511.515076:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:3306:x1874531125918080:12345-0@lo:103:ldlm_bl.0 Request processed in 371us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692511.515084:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787692511.515114:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25c21df9-20cc-4624-87d0-9b55ad554e5c:3306:1874531125918080:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787692511.527640:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:15755:x1874531125917824:12345-0@lo:253:mount.lustre.0 Request processed in 54895us (55064us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692511.527655:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787692511.527961:0:15755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:25c21df9-20cc-4624-87d0-9b55ad554e5c:15755:1874531125917824:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787692511.527977:0:15755:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787692511.527980:0:15755:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787692511.527982:0:15755:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787692511.527983:0:15755:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787692511.527984:0:15755:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787692511.527986:0:15755:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787692511.527987:0:15755:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787692511.527988:0:15755:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787692511.527990:0:15755:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787692511.527992:0:15755:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787692511.528006:0:15755:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787692511.532618:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692511.533328:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787692511.533517:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692511.533745:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787692511.534010:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787692511.534227:0:15755:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787692511.535125:0:15755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787692511.583030:0:15755:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1787692511.583039:0:15755:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1787692511.583069:0:15755:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787692511.583124:0:15755:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.127@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787692511.583141:0:15755:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1787692511.583166:0:15755:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787692512.001053:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.025396:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787692513.478316:0:14354:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787692513.478327:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff92ec88172800 from 8 10000000:01000000:1.0:1787692513.478333:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787692513.478394:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88164600/0x5d8b8560a09df4f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.478409:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec88164600/0x5d8b8560a09df4f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.478423:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec88164600/0x5d8b8560a09df4f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692513.478485:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125918208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787692513.478577:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692513.478647:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eca6cfbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787692513.481296:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125918208 00000100:00100000:3.0:1787692513.481317:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125918208 00000100:00100000:3.0:1787692513.481387:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787692513.481400:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:14354:x1874531125918208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787692513.481423:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692513.481449:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec8b35bc00/0x5d8b8560a09df4f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df4f2 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.481499:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec8b35bc00/0x5d8b8560a09df4f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df4f2 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.481513:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec8b35bc00/0x5d8b8560a09df4f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df4f2 expref: 19 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.481524:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35bc00, rc 0) 00000100:00100000:3.0:1787692513.481634:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:14354:x1874531125918208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 237us (3056us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692513.481643:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787692513.483067:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125918208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692513.483103:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec88164600/0x5d8b8560a09df4f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df4f9 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.483117:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec88164600/0x5d8b8560a09df4f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df4f9 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692513.483217:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125918336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787692513.483287:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692513.483334:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec904000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692513.483439:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125918336 00000100:00100000:1.0:1787692513.483447:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125918336 00000100:00100000:1.0:1787692513.483525:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787692513.483536:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:14354:x1874531125918336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787692513.483558:0:14349:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787692513.483578:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787692513.483582:0:14349:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787692513.483677:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:14354:x1874531125918336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692513.483686:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787692513.483729:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125918336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787692513.483802:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787692513.483846:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88164600/0x5d8b8560a09df4f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df4f9 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.483856:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec88164600/0x5d8b8560a09df4f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df4f9 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692513.537397:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787692498/real 1787692498] req@ffff92ec903b1500 x1874531125910912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787692513 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692513.537434:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92ec903b1500 x1874531125910912/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787692513 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692513.537467:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787692498/real 1787692498] req@ffff92ec903b3480 x1874531125911040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787692513 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692513.537480:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff92ec903b3480 x1874531125911040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787692513 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787692513.537498:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ec91cc2800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787692513.537524:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787692513.537529:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125910912:0@lo:8:kworker.0 00000100:00080000:0.0:1787692513.537535:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ecb7096800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787692513.537540:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787692513.537543:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125911040:0@lo:8:kworker.0 00000100:00080000:3.0:1787692513.537621:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787692513.537627:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787692513.537639:0:8:0:(import.c:65:import_set_state_nolock()) ffff92ec91cc2800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787692513.537644:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 404 00000100:00080000:3.0:1787692513.537648:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787692513.537655:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff92ec91cc2800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:3.0:1787692513.537686:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecaf685180 x1874531125918464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787692513.537711:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787692513.537714:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787692513.537715:0:8:0:(import.c:65:import_set_state_nolock()) ffff92ecb7096800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787692513.537718:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 404 00000100:00080000:3.0:1787692513.537721:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787692513.537723:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92ecb7096800 using connection 192.168.206.127@tcp/0@lo 00000100:00100000:3.0:1787692513.537734:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92ecaf686300 x1874531125918592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787692513.537973:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125918464:0@lo:8:kworker.0 00000100:00100000:0.0:1787692513.538039:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692513.538076:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125918592:0@lo:8:kworker.0 00000100:00100000:0.0:1787692513.538101:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692513.538405:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125918720:0@lo:400:kworker.0 00000100:00100000:1.0:1787692513.538436:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692513.538525:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125918464 00000100:00100000:1.0:1787692513.538532:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125918464 00000100:00100000:1.0:1787692513.538554:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125918592 00000100:00100000:1.0:1787692513.538563:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125918592 00000100:00100000:1.0:1787692513.538579:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787692513.538585:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874531125918464:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787692513.538610:0:15039:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:1.0:1787692513.538636:0:15039:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d8b8560a09df500 00002000:00100000:1.0:1787692513.538651:0:15039:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff92eb850e0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787692513.538656:0:15039:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1787692513.538659:0:15039:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1787692513.538783:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125918848:0@lo:400:kworker.0 00000100:00100000:2.0:1787692513.538877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692513.538940:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787692513.538950:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125918976:0@lo:400:kworker.0 00000100:00100000:2.0:1787692513.538984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692513.539223:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125918720 00000100:00100000:3.0:1787692513.539230:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125918720 00000100:00100000:3.0:1787692513.539257:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125918848 00000100:00100000:3.0:1787692513.539260:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125918848 00000100:00100000:3.0:1787692513.539287:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125918976 00000100:00100000:3.0:1787692513.539290:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125918976 00000100:00100000:3.0:1787692513.539304:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787692513.539310:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125918720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692513.539374:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125918720:12345-0@lo:400:kworker.0 Request processed in 63us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692513.539381:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787692513.539397:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787692513.539402:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125918848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692513.539448:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125918848:12345-0@lo:400:kworker.0 Request processed in 46us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692513.539454:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787692513.539467:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787692513.539474:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125918976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692513.539502:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874531125918976:12345-0@lo:400:kworker.0 Request processed in 29us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692513.539507:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1787692513.539544:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf684000 x1874531125918976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692513.539558:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874531125918976:0@lo:400:kworker.0 00010000:00080000:3.0:1787692513.539569:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf687800 x1874531125918848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692513.539577:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125918848:0@lo:400:kworker.0 00002000:00080000:1.0:1787692513.540413:0:15039:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787692513.540441:0:15039:0:(import.c:65:import_set_state_nolock()) ffff92eb850e0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787692513.540544:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874531125918464:12345-0@lo:8:kworker.0 Request processed in 1957us (2504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692513.540552:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787692513.540573:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787692513.540578:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874531125918592:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1787692513.540598:0:15039:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 419 last 0 00000020:00000080:1.0:1787692513.540619:0:15039:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5d8b8560a09df507 00002000:00100000:1.0:1787692513.540632:0:15039:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff92eb850e3000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113950 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787692513.540636:0:15039:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1787692513.540639:0:15039:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787692513.540958:0:15039:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787692513.540994:0:15039:0:(import.c:65:import_set_state_nolock()) ffff92eb850e4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787692513.541029:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeedad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874531125918592:12345-0@lo:8:kworker.0 Request processed in 449us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692513.541035:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787692513.541070:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787692513.541247:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf687b80 x1874531125918720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692529 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692513.541261:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125918720:0@lo:400:kworker.0 00010000:00080000:0.0:1787692513.546166:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf685180 x1874531125918464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787692533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692513.546181:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787692513.546193:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787692513.546204:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787692513.546210:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787692513.546213:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ec91cc2800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787692513.546291:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787692513.546298:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125918464:0@lo:8:kworker.0 00000004:00080000:2.0:1787692513.546318:0:14378:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:1.0:1787692513.546449:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf686300 x1874531125918592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787692533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787692513.546459:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787692513.546464:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787692513.546469:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787692513.546472:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787692513.546474:0:3303:0:(import.c:65:import_set_state_nolock()) ffff92ecb7096800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787692513.546486:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787692513.546490:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874531125918592:0@lo:8:kworker.0 00000004:00080000:0.0:1787692513.546601:0:14381:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787692513.546622:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14381:1874531125919232:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787692513.546677:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692513.546706:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec904006c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787692513.546737:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125919232 00000100:00100000:0.0:1787692513.546744:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125919232 00000100:00100000:0.0:1787692513.546802:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787692513.546852:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14381:x1874531125919232:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787692513.547179:0:14378:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 419753364631ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787692513.547932:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125919104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787692513.547981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787692513.548038:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787692513.554063:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125919104 00000100:00100000:2.0:1787692513.554075:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125919104 00000100:00100000:2.0:1787692513.554133:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787692513.554146:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874531125919104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787692513.554183:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692513.554270:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874531125919104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (6286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692513.554284:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1787692513.554313:0:14380:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787692513.554714:0:14380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 419760900607ns, next at 0ns, rc = 0 00010000:00080000:2.0:1787692513.554771:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeedaa00 x1874531125919104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787692513.554793:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125919104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692513.555022:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125919360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787692513.555072:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787692513.555126:0:14379:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787692513.555131:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125919360 00000100:00100000:3.0:1787692513.555137:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125919360 00000100:00100000:2.0:1787692513.555151:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14379:1874531125919488:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787692513.555182:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787692513.555187:0:14379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692513.555192:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874531125919360:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787692513.555209:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9050dcc0 going to sleep for 11 seconds 00002000:00000024:3.0:1787692513.555217:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692513.555259:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874531125919360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692513.555265:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1787692513.555293:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787692513.555313:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaf687800 x1874531125919360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787692529 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787692513.555327:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125919360:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1787692513.556075:0:15040:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787692513.556083:0:15040:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787692513.556088:0:15040:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00100000:2.0:1787692513.557061:0:15039:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787692513.557158:0:15039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787692513.559162:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125919488 00000100:00100000:3.0:1787692513.559174:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125919488 00000100:00100000:3.0:1787692513.559299:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787692513.559310:0:15856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14379:x1874531125919488:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787692513.561863:0:15856:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787692513.561873:0:15856:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787692513.561878:0:15856:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1787692513.577464:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.577479:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df50e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.577500:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.577506:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.577514:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df50e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.577535:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df50e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.577549:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df50e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.577557:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df50e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.577590:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.577606:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.577613:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df50e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.577620:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1400 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.577626:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df50e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.577635:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df50e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.577656:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df50e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.577664:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df50e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.577684:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.577686:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.577688:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.578446:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.578456:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df515 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.578469:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.578481:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.578487:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.578500:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.578509:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df515 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.578517:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.578542:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.578557:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.578562:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.578572:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.578576:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df515 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.578584:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df515 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.578600:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df515 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.578620:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df515 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.578637:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.578639:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.578640:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.583173:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.583189:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df51c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583212:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.583218:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.583225:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583243:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583256:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df51c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583264:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df51c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583292:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.583308:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.583326:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df51c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583336:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0c00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.583342:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df51c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583352:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df51c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583376:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df51c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583385:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df51c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583414:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.583416:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.583419:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.583421:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.583436:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb03982d/0x5d8b8560a09df523 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.583456:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.583461:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.583469:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb03982d/0x5d8b8560a09df523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.583490:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb03982d/0x5d8b8560a09df523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.583501:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb03982d/0x5d8b8560a09df523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.583510:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb03982d/0x5d8b8560a09df523 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.583550:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.583561:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.583569:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb03982d/0x5d8b8560a09df523 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583579:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b000 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.583583:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb03982d/0x5d8b8560a09df523 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583606:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb03982d/0x5d8b8560a09df523 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583621:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb03982d/0x5d8b8560a09df523 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583629:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb03982d/0x5d8b8560a09df523 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.583654:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.583656:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.583659:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.584288:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.584297:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df52a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584310:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.584315:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.584321:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df52a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584333:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df52a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584341:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df52a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584357:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df52a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584378:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.584392:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.584397:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df52a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584404:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1e00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.584409:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df52a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584417:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df52a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584431:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df52a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584438:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df52a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584465:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.584468:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.584473:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.584628:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.584641:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060e6e834/0x5d8b8560a09df531 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.584655:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.584659:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.584666:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060e6e834/0x5d8b8560a09df531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.584679:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060e6e834/0x5d8b8560a09df531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.584689:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000060e6e834/0x5d8b8560a09df531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.584696:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060e6e834/0x5d8b8560a09df531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.584722:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.584730:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.584744:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060e6e834/0x5d8b8560a09df531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584754:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35ac00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.584760:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060e6e834/0x5d8b8560a09df531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584770:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060e6e834/0x5d8b8560a09df531 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584788:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060e6e834/0x5d8b8560a09df531 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.584796:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060e6e834/0x5d8b8560a09df531 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.586144:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.586152:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.586156:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.589323:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.589343:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df538 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.589366:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.589372:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.589380:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.589417:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.589430:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df538 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787692513.589432:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.589454:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.589456:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539b450c/0x5d8b8560a09df53f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.589497:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.589509:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.589512:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.589523:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000539b450c/0x5d8b8560a09df53f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.589534:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.589542:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.589552:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1400 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.589555:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000539b450c/0x5d8b8560a09df53f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.589559:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df538 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.589595:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000539b450c/0x5d8b8560a09df53f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.589597:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.589620:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000539b450c/0x5d8b8560a09df53f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.589649:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.589959:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df538 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.589970:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df538 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.590002:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.590007:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000539b450c/0x5d8b8560a09df53f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.590014:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35aa00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.590017:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000539b450c/0x5d8b8560a09df53f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.590025:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000539b450c/0x5d8b8560a09df53f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.590036:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000539b450c/0x5d8b8560a09df53f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.590044:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000539b450c/0x5d8b8560a09df53f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.590059:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.590061:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.590063:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.590076:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.592330:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.592348:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df546 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.592368:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.592389:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.592397:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.592413:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.592425:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df546 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.592433:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.592461:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.592481:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.592487:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.592494:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0a00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.592499:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df546 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.592509:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df546 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.592528:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df546 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.592548:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df546 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.592572:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.592574:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.592576:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.593656:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.593671:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b10b93b/0x5d8b8560a09df54d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.593689:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.593694:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.593700:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b10b93b/0x5d8b8560a09df54d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.593716:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b10b93b/0x5d8b8560a09df54d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.593727:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b10b93b/0x5d8b8560a09df54d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.593742:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b10b93b/0x5d8b8560a09df54d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.593769:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787692513.594337:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692513.594345:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b10b93b/0x5d8b8560a09df54d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.594355:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b400 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692513.594360:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b10b93b/0x5d8b8560a09df54d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787692513.594361:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.594373:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4bd61f8/0x5d8b8560a09df554 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.594376:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b10b93b/0x5d8b8560a09df54d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.594391:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.594396:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.594405:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4bd61f8/0x5d8b8560a09df554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.594417:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4bd61f8/0x5d8b8560a09df554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.594421:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b10b93b/0x5d8b8560a09df54d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.594431:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4bd61f8/0x5d8b8560a09df554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.594433:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b10b93b/0x5d8b8560a09df54d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.594454:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4bd61f8/0x5d8b8560a09df554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.594466:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692513.594470:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4bd61f8/0x5d8b8560a09df554 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.594472:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787692513.594481:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692513.594485:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4bd61f8/0x5d8b8560a09df554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.594493:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4bd61f8/0x5d8b8560a09df554 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.594503:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4bd61f8/0x5d8b8560a09df554 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.594511:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4bd61f8/0x5d8b8560a09df554 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.594524:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692513.594526:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692513.594536:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692513.594552:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.595009:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.595016:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009649b70d/0x5d8b8560a09df55b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.595030:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.595033:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.595037:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009649b70d/0x5d8b8560a09df55b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.595046:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009649b70d/0x5d8b8560a09df55b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.595054:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009649b70d/0x5d8b8560a09df55b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.595060:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009649b70d/0x5d8b8560a09df55b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.595076:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787692513.595276:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692513.595282:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009649b70d/0x5d8b8560a09df55b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.595290:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692513.595294:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009649b70d/0x5d8b8560a09df55b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.595301:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009649b70d/0x5d8b8560a09df55b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.595312:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009649b70d/0x5d8b8560a09df55b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.595318:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009649b70d/0x5d8b8560a09df55b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.595331:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692513.595333:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692513.595335:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.596792:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.596803:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d01824ab/0x5d8b8560a09df562 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.596836:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.596840:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.596846:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d01824ab/0x5d8b8560a09df562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.597994:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d01824ab/0x5d8b8560a09df562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.598023:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d01824ab/0x5d8b8560a09df562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.598030:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d01824ab/0x5d8b8560a09df562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.598053:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787692513.599366:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.599379:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f7e5e7e/0x5d8b8560a09df569 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599394:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.599398:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.599403:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f7e5e7e/0x5d8b8560a09df569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599414:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f7e5e7e/0x5d8b8560a09df569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599422:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f7e5e7e/0x5d8b8560a09df569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599430:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f7e5e7e/0x5d8b8560a09df569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599463:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787692513.599476:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787692513.599482:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d01824ab/0x5d8b8560a09df562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599488:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a000 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.599493:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d01824ab/0x5d8b8560a09df562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599502:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d01824ab/0x5d8b8560a09df562 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599517:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d01824ab/0x5d8b8560a09df562 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599526:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d01824ab/0x5d8b8560a09df562 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599560:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.599563:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f7e5e7e/0x5d8b8560a09df569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599570:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a800 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.599573:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f7e5e7e/0x5d8b8560a09df569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599591:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f7e5e7e/0x5d8b8560a09df569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599601:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f7e5e7e/0x5d8b8560a09df569 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599609:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f7e5e7e/0x5d8b8560a09df569 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.599620:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.599622:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.599624:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.600326:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.600334:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df570 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.600343:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.600347:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.600352:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.600360:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.600368:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.600381:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.600396:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.600406:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.600411:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.600418:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b15000 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.600422:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.600431:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.600444:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df570 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.600451:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df570 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.600467:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.600469:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.600471:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692513.600674:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.602918:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.602936:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df577 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.602957:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.602962:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.602969:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.602985:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.602996:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df577 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.603005:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.603036:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787692513.603263:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692513.603276:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.603290:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1e00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692513.603303:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df577 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.603315:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df577 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.603337:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df577 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.603345:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df577 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.603369:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692513.603372:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692513.603374:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.603783:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.603797:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df57e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.603808:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.603841:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.603846:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df57e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.603859:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df57e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.603868:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df57e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.603875:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df57e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.603903:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787692513.605261:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692513.605273:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df57e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.605286:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0c00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692513.605290:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df57e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.605300:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df57e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.605318:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df57e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.605333:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df57e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.605354:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692513.605356:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692513.605358:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.605971:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.605988:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df585 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.606000:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.606005:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.606011:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.606023:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.606032:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.606040:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.606059:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.606069:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.606073:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.606079:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b14000 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.606082:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.606600:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df585 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.606623:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df585 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.606631:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df585 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.606649:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.606651:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.606653:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.607515:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.607531:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df58c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.607549:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.607554:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.607561:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df58c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.607576:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df58c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.607597:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df58c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.607606:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df58c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.607642:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.607664:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.607671:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df58c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.607679:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.607685:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df58c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.607694:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df58c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.607713:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df58c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.607721:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df58c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.607749:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.607764:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.607768:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.608575:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.608586:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cca90179/0x5d8b8560a09df593 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.608597:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.608601:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.608607:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cca90179/0x5d8b8560a09df593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.608619:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cca90179/0x5d8b8560a09df593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.608627:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cca90179/0x5d8b8560a09df593 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.608634:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cca90179/0x5d8b8560a09df593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.608664:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.608677:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.608690:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cca90179/0x5d8b8560a09df593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.608704:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1a00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.608710:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cca90179/0x5d8b8560a09df593 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.608721:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cca90179/0x5d8b8560a09df593 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.608746:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cca90179/0x5d8b8560a09df593 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.608755:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cca90179/0x5d8b8560a09df593 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.608809:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.608867:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.608873:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.609109:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.609120:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df59a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609132:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.609138:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.609145:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df59a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609161:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df59a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609171:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df59a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609179:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df59a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609206:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.609219:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.609226:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df59a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609248:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b15400 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.609252:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df59a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609260:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df59a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609272:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df59a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609279:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df59a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609296:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.609298:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.609300:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.609638:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.609648:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df5a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.609663:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.609668:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.609674:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.609698:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.609707:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df5a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.609715:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.609749:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.609759:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.609769:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609779:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0a00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.609784:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df5a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609796:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df5a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609869:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df5a1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609878:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df5a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.609908:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.609912:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.609914:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.610947:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.610957:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df5a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.610968:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.610973:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.610978:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df5a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.610989:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df5a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.610998:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df5a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.611005:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df5a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.611038:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.611051:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.611056:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df5a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.611063:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b15a00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.611066:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df5a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.611074:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df5a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.611163:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df5a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.611171:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df5a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.611187:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.611189:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.611190:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.611779:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.611787:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b198511c/0x5d8b8560a09df5af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.611795:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.611804:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.611829:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b198511c/0x5d8b8560a09df5af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.611842:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b198511c/0x5d8b8560a09df5af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.612212:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b198511c/0x5d8b8560a09df5af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.612223:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b198511c/0x5d8b8560a09df5af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.612245:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787692513.612524:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787692513.612533:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b198511c/0x5d8b8560a09df5af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.612543:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b15200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692513.612548:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b198511c/0x5d8b8560a09df5af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.612557:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b198511c/0x5d8b8560a09df5af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.612572:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b198511c/0x5d8b8560a09df5af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.612580:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b198511c/0x5d8b8560a09df5af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.612604:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692513.612607:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692513.612608:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.612930:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.612942:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df5b6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.612959:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.612965:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.612973:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.612989:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.613001:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df5b6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.613024:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df5b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.613060:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.613170:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.613182:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df5b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.613192:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1400 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.613197:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df5b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.613207:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df5b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.613223:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df5b6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.613245:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005b96982/0x5d8b8560a09df5b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.613271:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.613276:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.613278:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.613746:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.613754:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df5bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.613765:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.613770:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.613776:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df5bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.613788:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df5bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.613797:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df5bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.613804:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df5bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.613841:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.614055:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.614065:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df5bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614073:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b14200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.614077:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df5bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614138:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df5bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614152:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df5bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614160:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df5bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614178:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.614180:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.614182:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.614760:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.614767:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df5c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614776:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.614780:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.614785:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df5c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614806:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df5c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614835:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df5c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614842:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df5c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614943:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.614953:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.614957:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df5c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614964:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b14600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.614966:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df5c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614973:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df5c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614984:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df5c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.614990:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df5c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.615011:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.615013:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.615015:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.616233:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.616243:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df5cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.616255:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.616260:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.616266:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df5cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.616278:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df5cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.616287:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df5cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.616295:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df5cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.616312:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.616321:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.616325:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df5cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.616344:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b15800 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.616349:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df5cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.616357:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df5cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.616372:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df5cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.616379:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df5cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.616411:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.616414:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.616417:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.617036:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.617050:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df5d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.617066:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.617071:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.617078:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.617093:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.617104:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df5d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.617112:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df5d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.617144:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.617159:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.617170:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df5d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.617180:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.617187:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df5d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.617198:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df5d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.617225:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df5d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.617232:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058496c18/0x5d8b8560a09df5d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.617270:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.617274:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.617281:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.618007:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.618020:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df5d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618039:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.618043:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.618050:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df5d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618062:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df5d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618072:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df5d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618080:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df5d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787692513.618139:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.618146:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.618151:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df5e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.618166:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.618171:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.618178:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df5e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.618192:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df5e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.618198:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.618203:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df5e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.618209:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df5d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.618213:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df5e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.618227:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1800 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692513.618233:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df5d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.618250:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df5d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.618267:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787692513.618273:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df5d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.618281:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692513.618297:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df5d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.618332:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.618336:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.618338:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.618723:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.618731:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000503c3cc9/0x5d8b8560a09df5e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618740:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.618743:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.618748:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000503c3cc9/0x5d8b8560a09df5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618758:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000503c3cc9/0x5d8b8560a09df5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618777:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000503c3cc9/0x5d8b8560a09df5e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618783:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000503c3cc9/0x5d8b8560a09df5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618803:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.618846:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.618851:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000503c3cc9/0x5d8b8560a09df5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618859:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0000 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.618864:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000503c3cc9/0x5d8b8560a09df5e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618873:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000503c3cc9/0x5d8b8560a09df5e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618889:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000503c3cc9/0x5d8b8560a09df5e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618908:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000503c3cc9/0x5d8b8560a09df5e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.618926:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.618934:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.618936:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.619367:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.619373:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09df5ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.619383:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.619387:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.619391:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09df5ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.619403:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09df5ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.619412:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09df5ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.619421:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09df5ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.619444:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.619458:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.619464:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09df5ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.619472:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0800 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.619477:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09df5ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.619497:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09df5ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.619512:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09df5ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.619520:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057a42814/0x5d8b8560a09df5ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.619539:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.619541:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.619543:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.620014:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.620021:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097047df3/0x5d8b8560a09df5f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.620030:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.620034:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.620038:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097047df3/0x5d8b8560a09df5f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.620047:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097047df3/0x5d8b8560a09df5f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.620056:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097047df3/0x5d8b8560a09df5f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.620071:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097047df3/0x5d8b8560a09df5f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.620090:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.620100:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.620105:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097047df3/0x5d8b8560a09df5f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.620111:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.620115:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097047df3/0x5d8b8560a09df5f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.620124:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097047df3/0x5d8b8560a09df5f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.620136:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097047df3/0x5d8b8560a09df5f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.620144:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097047df3/0x5d8b8560a09df5f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.620159:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.620161:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.620162:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.620467:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.620472:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df5e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.620473:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.620478:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.620489:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b14000 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.620495:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df5e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.620506:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df5e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.620528:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df5e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.620780:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df5e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.620928:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.620931:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.620935:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.620977:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.620997:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df5fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.621009:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.621013:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.621019:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df5fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.621033:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df5fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.621043:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df5fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.621051:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df5fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.621070:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.621083:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.621088:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df5fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.621096:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0c00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.621100:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df5fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.621108:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df5fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.621127:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df5fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.621135:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df5fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.621152:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.621154:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.621157:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.621717:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.621727:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df603 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.621741:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.621753:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.621759:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.621773:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.621782:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.621789:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.621931:0:15864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692513.621938:0:15864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df603 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.621947:0:15864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b15400 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692513.621951:0:15864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df603 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.621959:0:15864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df603 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.621975:0:15864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df603 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.621982:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.621984:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.621986:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.622002:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787692513.622009:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df603 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787692513.622959:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.622968:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df60a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.622979:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.622983:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.622988:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df60a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.623004:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df60a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.623020:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df60a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.623028:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df60a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.623049:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787692513.624037:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.624049:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df611 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.624059:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.624063:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.624068:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.624068:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692513.624077:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df60a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.624083:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.624088:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b15800 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692513.624094:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df60a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.624167:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df60a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.624183:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df60a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.624191:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e85dcea2/0x5d8b8560a09df60a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.624209:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.624211:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.624212:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.624658:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.624666:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.624946:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787692513.626466:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.626482:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df618 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.626501:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.626507:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.626514:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.626532:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.626543:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df618 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.626550:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df618 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787692513.629410:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.629653:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df61f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.629669:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.629673:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.629679:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df61f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.629693:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df61f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.629703:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df61f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.629710:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df61f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.630709:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787692513.630721:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.630734:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b14600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692513.630738:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.630761:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.630781:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df611 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.630789:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093641302/0x5d8b8560a09df611 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.630827:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787692513.630832:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.630839:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1e00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692513.630841:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df618 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.630849:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df618 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.630859:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df618 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.631568:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692513.631573:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df61f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.631586:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b14200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692513.631590:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df61f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.631598:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df61f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.631609:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df61f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.631617:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.631619:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.631622:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.631735:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787692513.631752:0:15040:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df618 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.631915:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787692513.633347:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1787692513.634767:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.634785:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df626 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.634919:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.634928:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.634936:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.634956:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.634968:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df626 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.634977:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.635015:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787692513.635042:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787692513.635058:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.635144:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0a00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692513.635150:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.635161:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.635182:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df626 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.635394:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787692513.635410:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df61f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.635461:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.636999:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df626 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.637055:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.637058:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787692513.637065:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787692513.640291:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.640311:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df62d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.640334:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.640340:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.640348:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df62d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.640382:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df62d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.640406:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df62d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.640417:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df62d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.640442:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787692513.640975:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.640998:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df634 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641015:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.641020:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.641027:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641041:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641051:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641058:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641076:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787692513.641089:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787692513.641095:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df62d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641103:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0c00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.641108:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df62d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641116:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df62d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641139:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df62d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641147:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df62d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641168:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.641171:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641178:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b15a00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.641181:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641189:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df634 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641199:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df634 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641205:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df743f04/0x5d8b8560a09df634 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641218:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.641220:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.641227:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.641779:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.641788:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df63b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641798:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.641802:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.641806:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df63b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.641844:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df63b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.642643:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.643312:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df63b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.643324:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df63b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.643351:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787692513.643860:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692513.643875:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df63b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.643885:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b15000 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692513.643891:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df63b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.643910:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df63b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.643929:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df63b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.643944:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a866c820/0x5d8b8560a09df63b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.643965:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.643967:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.643969:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.644446:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.644455:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad61535b/0x5d8b8560a09df642 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.644468:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.644472:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.644478:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad61535b/0x5d8b8560a09df642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.644505:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad61535b/0x5d8b8560a09df642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.644514:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad61535b/0x5d8b8560a09df642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.644522:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad61535b/0x5d8b8560a09df642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.644617:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.644628:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.644642:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad61535b/0x5d8b8560a09df642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.644649:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b14e00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.644653:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad61535b/0x5d8b8560a09df642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.644661:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad61535b/0x5d8b8560a09df642 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.644672:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad61535b/0x5d8b8560a09df642 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.644680:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad61535b/0x5d8b8560a09df642 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.644700:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.644702:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.644704:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.645339:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.645346:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8ab2d3/0x5d8b8560a09df649 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.645355:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.645359:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.645364:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a8ab2d3/0x5d8b8560a09df649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.645373:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a8ab2d3/0x5d8b8560a09df649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.645380:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a8ab2d3/0x5d8b8560a09df649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.645388:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a8ab2d3/0x5d8b8560a09df649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.645404:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787692513.645919:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787692513.645934:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df650 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.645951:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=419s v=(0 0) 00010000:00010000:0.0:1787692513.645957:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787692513.645964:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.645981:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.645992:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df650 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.646019:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692513.646047:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787692513.646272:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787692513.646280:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a8ab2d3/0x5d8b8560a09df649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.646290:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b15c00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692513.646295:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8ab2d3/0x5d8b8560a09df649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.646304:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a8ab2d3/0x5d8b8560a09df649 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.646321:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a8ab2d3/0x5d8b8560a09df649 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.646327:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a8ab2d3/0x5d8b8560a09df649 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.646353:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692513.646357:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.646371:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0a00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692513.646375:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df650 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.646383:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df650 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.646394:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df650 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.646403:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001abd22b2/0x5d8b8560a09df650 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.646421:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.646423:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.646426:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.646511:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.646518:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df657 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.646552:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.646556:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.646562:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.646572:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.646580:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.646588:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.646706:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787692513.647399:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.647406:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df65e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.647415:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.647418:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.647422:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df65e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.647432:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df65e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.647453:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df65e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.647460:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df65e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.647476:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787692513.647486:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787692513.647491:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.647497:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b14200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.647500:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.647507:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df657 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.647521:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df657 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.647528:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a6faf7d/0x5d8b8560a09df657 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.648018:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692513.648025:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df65e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.648034:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b15400 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692513.648037:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df65e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.648046:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df65e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.648066:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df65e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.648074:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038804d01/0x5d8b8560a09df65e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.648091:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.648093:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.648095:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787692513.649223:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787692513.649233:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09df665 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.649245:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=419s v=(0 0) 00010000:00010000:1.0:1787692513.649249:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692513.649256:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09df665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.649270:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09df665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.649278:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09df665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.649286:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09df665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.649304:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787692513.649712:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787692513.649718:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df66c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.649728:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=419s v=(0 0) 00010000:00010000:1.0:1787692513.649730:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692513.649734:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df66c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.649755:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df66c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.649763:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df66c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.649769:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df66c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.649777:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787692513.651010:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787692513.651030:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09df665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.651043:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164800 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.651048:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09df665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.651059:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09df665 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.651079:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09df665 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.651086:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd47558d/0x5d8b8560a09df665 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.651106:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.651110:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df66c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.651115:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.651119:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df66c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.651125:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df66c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.651150:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df66c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.651157:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df66c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.651169:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.651173:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.651175:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.651209:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.652280:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787692513.652600:0:15856:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787692513.652610:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df673 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.652625:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1787692513.652630:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692513.652637:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.652651:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.652661:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.652670:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.652700:0:15856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.652717:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.652723:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.652734:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b14000 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.652739:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.652748:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df673 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.652766:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df673 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.652774:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fda85e6a/0x5d8b8560a09df673 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.652797:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.652799:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.652801:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1787692513.653168:0:15856:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1787692513.653256:0:15856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14379:x1874531125919488:12345-0@lo:5:osp-pre-0-0.0 Request processed in 93943us (98064us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692513.653266:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00002000:00010000:1.0:1787692513.653294:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787692513.653302:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990a9bbb/0x5d8b8560a09df67a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.653311:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=419s v=(0 0) 00010000:00010000:1.0:1787692513.653314:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692513.653319:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990a9bbb/0x5d8b8560a09df67a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.653328:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990a9bbb/0x5d8b8560a09df67a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.653336:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990a9bbb/0x5d8b8560a09df67a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.653354:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000990a9bbb/0x5d8b8560a09df67a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.653373:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787692513.654137:0:15864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692513.654145:0:15864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000990a9bbb/0x5d8b8560a09df67a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.654155:0:15864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692513.654159:0:15864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000990a9bbb/0x5d8b8560a09df67a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.654168:0:15864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000990a9bbb/0x5d8b8560a09df67a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.654186:0:15864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000990a9bbb/0x5d8b8560a09df67a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.654193:0:15864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000990a9bbb/0x5d8b8560a09df67a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692513.654211:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.654213:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692513.654215:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692513.654875:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14379:1874531125919488:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787692513.654904:0:14379:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787692513.654964:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14379:1874531125919616:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787692513.655032:0:14379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692513.655093:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9050dcc0 going to sleep for 11 seconds 00002000:00010000:1.0:1787692513.656642:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787692513.656654:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036dc65eb/0x5d8b8560a09df681 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.656670:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=419s v=(0 0) 00010000:00010000:1.0:1787692513.656675:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692513.656681:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036dc65eb/0x5d8b8560a09df681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.656696:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036dc65eb/0x5d8b8560a09df681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.656707:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036dc65eb/0x5d8b8560a09df681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.656715:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036dc65eb/0x5d8b8560a09df681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.656733:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787692513.657011:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692513.657019:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036dc65eb/0x5d8b8560a09df681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.657028:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165800 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692513.657033:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036dc65eb/0x5d8b8560a09df681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.657042:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036dc65eb/0x5d8b8560a09df681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.657070:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036dc65eb/0x5d8b8560a09df681 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.657078:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036dc65eb/0x5d8b8560a09df681 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.657112:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.657115:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.657118:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787692513.658294:0:15040:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787692513.658305:0:15040:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a218800/0x5d8b8560a09df688 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.658324:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=419s v=(0 0) 00010000:00010000:1.0:1787692513.658329:0:15040:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692513.658334:0:15040:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a218800/0x5d8b8560a09df688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.658346:0:15040:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a218800/0x5d8b8560a09df688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.658354:0:15040:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a218800/0x5d8b8560a09df688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.658363:0:15040:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a218800/0x5d8b8560a09df688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692513.658386:0:15040:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787692513.658576:0:15040:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1787692513.658672:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14381:x1874531125919232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 111858us (111990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692513.658682:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787692513.658710:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125919616 00000100:00100000:1.0:1787692513.658717:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125919616 00000100:00100000:1.0:1787692513.658765:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787692513.658773:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14379:x1874531125919616:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787692513.658832:0:15042:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1787692513.659035:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14381:1874531125919232:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787692513.659061:0:14381:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00010000:00010000:2.0:1787692513.659207:0:14345:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692513.659215:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a218800/0x5d8b8560a09df688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.659225:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165000 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692513.659230:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a218800/0x5d8b8560a09df688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.659240:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a218800/0x5d8b8560a09df688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.659255:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a218800/0x5d8b8560a09df688 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.659264:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a218800/0x5d8b8560a09df688 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15040 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692513.659303:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.659308:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692513.659311:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787692513.660276:0:14381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14381:1874531125919744:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787692513.660941:0:14381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692513.661001:0:14381:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec904006c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692513.664261:0:15856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125919744 00000100:00100000:3.0:1787692513.664273:0:15856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125919744 00000100:00100000:3.0:1787692513.664333:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787692513.664344:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaeed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14381:x1874531125919744:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1787692513.664388:0:15040:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:1.0:1787692513.669686:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14379:x1874531125919616:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10905us (14646us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787692513.669713:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787692513.669788:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14379:1874531125919616:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1787692513.669806:0:14379:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:3.0:1787692513.685374:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaeed8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14381:x1874531125919744:12345-0@lo:5:osp-pre-1-0.0 Request processed in 21022us (24426us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787692513.685387:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:1.0:1787692513.685490:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1787692513.686100:0:14381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14381:1874531125919744:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787692513.686188:0:14381:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1787692514.050749:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692515.076100:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787692515.728731:0:6703:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1787692515.728746:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1787692516.097780:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787692516.811473:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787692516.811490:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1787692517.123669:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787692517.624744:0:16112:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg627-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787692518.146766:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692518.724134:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125919872:0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.724174:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125920000:0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.724425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692518.724470:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125920512:0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.724500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692518.724529:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787692518.724535:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeeda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874531125920384:0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.724557:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692518.724584:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125920512 00000100:00100000:0.0:1787692518.724591:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125920512 00000100:00100000:0.0:1787692518.724637:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125920384 00000100:00100000:0.0:1787692518.724640:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125920384 00000100:00100000:0.0:1787692518.724657:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787692518.724665:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125920512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.724726:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125920512:12345-0@lo:400:kworker.0 Request processed in 61us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692518.724734:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787692518.724753:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787692518.724759:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874531125920384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.724786:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874531125920384:12345-0@lo:400:kworker.0 Request processed in 28us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692518.724792:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787692518.724846:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeeda300 x1874531125920384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692518.724860:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeeda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874531125920384:0@lo:400:kworker.0 00010000:00080000:0.0:1787692518.724882:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeedb800 x1874531125920512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692518.724890:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125920512:0@lo:400:kworker.0 00000100:00100000:3.0:1787692518.727538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692518.727848:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125919872 00000100:00100000:0.0:1787692518.727856:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125919872 00000100:00100000:0.0:1787692518.727914:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787692518.727923:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:3304:x1874531125919872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.728076:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:3304:x1874531125919872:12345-0@lo:400:kworker.0 Request processed in 153us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692518.728085:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1787692518.728120:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692518.728138:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125920000 00000100:00100000:0.0:1787692518.728142:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125920000 00000100:00100000:0.0:1787692518.728175:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787692518.728180:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125919872:0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.728190:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125920000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.728237:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125920000:12345-0@lo:400:kworker.0 Request processed in 48us (3813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692518.728244:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787692518.728267:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125920256:0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.728296:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692518.728317:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787692518.728323:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125920128:0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.728345:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692518.728364:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaeedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125920640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692518.728382:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692518.728406:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125920128 00000100:00100000:0.0:1787692518.728409:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125920128 00000100:00100000:0.0:1787692518.728431:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787692518.728437:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125920128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.728469:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125920128:12345-0@lo:400:kworker.0 Request processed in 32us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692518.728475:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787692518.728490:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125920256 00000100:00100000:0.0:1787692518.728493:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125920256 00000100:00100000:0.0:1787692518.728515:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787692518.728521:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125920256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.728549:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874531125920256:12345-0@lo:400:kworker.0 Request processed in 28us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692518.728555:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787692518.728571:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787692518.728579:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787692518.728586:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787692518.728597:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125920000:0@lo:400:kworker.0 00000100:00100000:0.0:1787692518.728606:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787692518.728614:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125920640 00000100:00100000:0.0:1787692518.728614:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125920128:0@lo:400:kworker.0 00000100:00100000:3.0:1787692518.728617:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125920640 00010000:00080000:0.0:1787692518.728625:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff92ecaeed8a80 x1874531125920256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787692534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787692518.728635:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874531125920256:0@lo:400:kworker.0 00000100:00100000:3.0:1787692518.728640:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787692518.728646:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125920640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787692518.728671:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692518.728706:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125920640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692518.728712:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787692518.728745:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaeedaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125920640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787692518.730232:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692518.730247:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125920768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787692518.730295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692518.730328:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125920768 00000100:00100000:3.0:1787692518.730334:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125920768 00000100:00100000:3.0:1787692518.730365:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787692518.730372:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125920768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787692518.730398:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787692518.730526:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125920768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692518.730533:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787692518.730575:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125920768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787692519.169878:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692519.553064:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692519.553137:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108101120 00000100:00100000:0.0:1787692519.553148:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108101120 00000100:00100000:0.0:1787692519.553196:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:0.0:1787692519.553205:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1874531108101120:12345-192.168.206.27@tcp:250:mount.lustre.0 00010000:00080000:0.0:1787692519.553231:0:14351:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 4b7addca-b783-44df-be6e-98e7ff20be97@192.168.206.27@tcp t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:0.0:1787692519.553259:0:14351:0:(genops.c:1385:class_connect()) connect: client 4b7addca-b783-44df-be6e-98e7ff20be97, cookie 0x5d8b8560a09df68f 00000100:00080000:0.0:1787692519.553391:0:14351:0:(import.c:65:import_set_state_nolock()) ffff92eb84d9d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787692519.553462:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+5:2360:x1874531108101120:12345-192.168.206.27@tcp:250:mount.lustre.0 Request processed in 256us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692519.553470:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 74 00000100:00100000:1.0:1787692519.557897:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692519.558094:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108101248 00000100:00100000:0.0:1787692519.558104:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108101248 00000100:00100000:0.0:1787692519.558163:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:0.0:1787692519.558173:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+5:13767:x1874531108101248:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787692519.558190:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692519.558207:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e1400/0x5d8b8560a09df696 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2602 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692519.558236:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e1400/0x5d8b8560a09df696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2602 expref: 6 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692519.558263:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecbc2e1400/0x5d8b8560a09df696 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2602 expref: 6 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692519.558273:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1400, rc 0) 00000100:00100000:0.0:1787692519.558331:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+6:13767:x1874531108101248:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 160us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692519.558338:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 75 00000100:00100000:2.0:1787692519.566645:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692519.566734:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108101376 00000100:00100000:1.0:1787692519.566744:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108101376 00000100:00100000:1.0:1787692519.566799:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 76 00000100:00100000:1.0:1787692519.566809:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+6:13767:x1874531108101376:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787692519.567086:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+6:13767:x1874531108101376:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 278us (451us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787692519.567095:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 76 00000100:00100000:2.0:1787692519.570672:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692519.570851:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108101504 00000100:00100000:3.0:1787692519.570860:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108101504 00000100:00100000:3.0:1787692519.570929:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 77 00000100:00100000:3.0:1787692519.570940:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+6:13767:x1874531108101504:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787692519.570956:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692519.570973:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec88b14000/0x5d8b8560a09df69d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2609 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692519.571003:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec88b14000/0x5d8b8560a09df69d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2609 expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692519.571015:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec88b14000/0x5d8b8560a09df69d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2609 expref: 7 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692519.571024:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88b14000, rc 0) 00000100:00100000:3.0:1787692519.573873:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+7:13767:x1874531108101504:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 2913us (3187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692519.573886:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 77 00000100:00100000:3.0:1787692519.579162:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692519.579278:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108101632 00000100:00100000:0.0:1787692519.579288:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108101632 00000100:00100000:0.0:1787692519.579345:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 78 00000100:00100000:0.0:1787692519.579356:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+7:13767:x1874531108101632:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787692519.579806:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+8:13767:x1874531108101632:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 450us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692519.579974:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 78 00000100:00100000:2.0:1787692519.596261:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692519.596437:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108101760 00000100:00100000:0.0:1787692519.596447:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108101760 00000100:00100000:0.0:1787692519.596881:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:0.0:1787692519.596894:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+8:13767:x1874531108101760:12345-192.168.206.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787692519.597126:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+8:13767:x1874531108101760:12345-192.168.206.27@tcp:503:mount.lustre.0 Request processed in 234us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692519.597135:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 79 00000100:00100000:2.0:1787692519.603795:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692519.604118:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108101888 00000100:00100000:1.0:1787692519.604128:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108101888 00000100:00100000:1.0:1787692519.604187:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00100000:1.0:1787692519.604197:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecc56dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+8:13785:x1874531108101888:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787692519.604478:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecc56dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+8:13785:x1874531108101888:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 281us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692519.604487:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 80 00000100:00100000:3.0:1787692519.624221:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692519.626025:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108102016 00000100:00100000:0.0:1787692519.626039:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108102016 00000100:00100000:0.0:1787692519.626109:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 81 00000100:00100000:0.0:1787692519.626119:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+8:13785:x1874531108102016:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787692519.626458:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+8:13785:x1874531108102016:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 338us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692519.626467:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 81 00000100:00100000:2.0:1787692519.633974:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692519.634065:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108102144 00000100:00100000:0.0:1787692519.634074:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108102144 00000100:00100000:0.0:1787692519.634136:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:0.0:1787692519.634146:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+8:13767:x1874531108102144:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787692519.634161:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692519.634180:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e1600/0x5d8b8560a09df6a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2633 expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692519.634209:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e1600/0x5d8b8560a09df6a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2633 expref: 9 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692519.634221:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecbc2e1600/0x5d8b8560a09df6a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2633 expref: 9 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692519.634229:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1600, rc 0) 00000100:00100000:0.0:1787692519.634290:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+9:13767:x1874531108102144:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 146us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692519.634296:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 82 00000100:00100000:2.0:1787692519.638082:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692519.638184:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108102272 00000100:00100000:1.0:1787692519.638193:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108102272 00000100:00100000:1.0:1787692519.638249:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 83 00000100:00100000:1.0:1787692519.638260:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+9:13767:x1874531108102272:12345-192.168.206.27@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787692519.638298:0:14349:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787692519.638317:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787692519.638323:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787692519.638326:0:14349:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787692519.638328:0:14349:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787692519.644232:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+9:13767:x1874531108102272:12345-192.168.206.27@tcp:256:mount.lustre.0 Request processed in 5963us (6148us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692519.644245:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 83 00000100:00100000:2.0:1787692519.648664:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692519.650295:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108102400 00000100:00100000:0.0:1787692519.650309:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108102400 00000100:00100000:0.0:1787692519.650371:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:0.0:1787692519.650382:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+9:13767:x1874531108102400:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787692519.650397:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692519.650426:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e1800/0x5d8b8560a09df6ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b263a expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692519.650453:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e1800/0x5d8b8560a09df6ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b263a expref: 10 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692519.650463:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecbc2e1800/0x5d8b8560a09df6ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b263a expref: 10 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692519.650471:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1800, rc 0) 00000100:00100000:0.0:1787692519.650537:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+10:13767:x1874531108102400:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 157us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692519.650543:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 84 00000100:00100000:2.0:1787692519.653701:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692519.653919:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108102528 00000100:00100000:1.0:1787692519.653929:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108102528 00000100:00100000:1.0:1787692519.653975:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:1.0:1787692519.653984:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+10:13767:x1874531108102528:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787692519.655284:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+10:13767:x1874531108102528:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 1294us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692519.655297:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 85 00000100:00100000:1.0:1787692519.657627:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692519.657717:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108102656 00000100:00100000:0.0:1787692519.657726:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108102656 00000100:00100000:0.0:1787692519.657780:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00100000:0.0:1787692519.657790:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+10:13767:x1874531108102656:12345-192.168.206.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787692519.658079:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+10:13767:x1874531108102656:12345-192.168.206.27@tcp:503:mount.lustre.0 Request processed in 290us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692519.658088:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 86 00000100:00100000:2.0:1787692519.660666:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692519.661154:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108102784 00000100:00100000:1.0:1787692519.661166:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108102784 00000100:00100000:1.0:1787692519.661234:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 87 00000100:00100000:1.0:1787692519.661245:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+10:13790:x1874531108102784:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787692519.661560:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+10:13790:x1874531108102784:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 315us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692519.661569:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 87 00000100:00100000:2.0:1787692519.668480:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692519.668634:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108102912 00000100:00100000:1.0:1787692519.668644:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108102912 00000100:00100000:1.0:1787692519.668703:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 88 00000100:00100000:1.0:1787692519.668726:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+10:13790:x1874531108102912:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787692519.669180:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+10:13790:x1874531108102912:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 453us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692519.669189:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 88 00000100:00100000:3.0:1787692519.675756:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692519.675983:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108103040 00000100:00100000:0.0:1787692519.675993:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108103040 00000100:00100000:0.0:1787692519.676099:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:0.0:1787692519.676108:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1874531108103040:12345-192.168.206.27@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787692519.676138:0:14356:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7d44c134-b57f-4e11-ae4b-9864d89ff88e@192.168.206.27@tcp t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:0.0:1787692519.676186:0:14356:0:(genops.c:1385:class_connect()) connect: client 7d44c134-b57f-4e11-ae4b-9864d89ff88e, cookie 0x5d8b8560a09df6b2 00000004:00100000:0.0:1787692519.676214:0:14356:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787692519.676233:0:14356:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1787692519.704109:0:14356:0:(import.c:65:import_set_state_nolock()) ffff92eb84d9f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787692519.704250:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:2360:x1874531108103040:12345-192.168.206.27@tcp:38:mount.lustre.0 Request processed in 28140us (28502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692519.704262:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:1.0:1787692519.710357:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692519.710425:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108103168 00000100:00100000:0.0:1787692519.710444:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108103168 00000100:00100000:1.0:1787692519.710458:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692519.710521:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108103296 00000100:00100000:2.0:1787692519.710527:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108103296 00000100:00100000:2.0:1787692519.710585:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:2.0:1787692519.710596:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:13767:x1874531108103296:12345-192.168.206.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787692519.710642:0:14357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1787692519.710657:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692519.710797:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:13767:x1874531108103296:12345-192.168.206.27@tcp:41:mount.lustre.0 Request processed in 145us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692519.710806:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:2.0:1787692519.710850:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:2.0:1787692519.710859:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:0:x1874531108103168:12345-192.168.206.27@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787692519.710897:0:14357:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787692519.710937:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:0:x1874531108103168:12345-192.168.206.27@tcp:41:mount.lustre.0 Request processed in 79us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692519.710944:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:1.0:1787692519.712301:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692519.712518:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108103424 00000100:00100000:0.0:1787692519.712526:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108103424 00000100:00100000:0.0:1787692519.712624:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:0.0:1787692519.712634:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:13767:x1874531108103424:12345-192.168.206.27@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787692519.712707:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:13767:x1874531108103424:12345-192.168.206.27@tcp:40:mount.lustre.0 Request processed in 74us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692519.712714:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:0.0:1787692519.715470:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692519.715509:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692519.715698:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108103552 00000100:00100000:1.0:1787692519.715708:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108103552 00000100:00100000:1.0:1787692519.715754:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108103680 00000100:00100000:1.0:1787692519.715758:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108103680 00000100:00100000:1.0:1787692519.715788:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:1.0:1787692519.715796:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1874531108103552:12345-192.168.206.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787692519.715872:0:15042:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7d44c134-b57f-4e11-ae4b-9864d89ff88e@192.168.206.27@tcp t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:1.0:1787692519.715905:0:15042:0:(genops.c:1385:class_connect()) connect: client 7d44c134-b57f-4e11-ae4b-9864d89ff88e, cookie 0x5d8b8560a09df6b9 00002000:00100000:1.0:1787692519.715916:0:15042:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7d44c134-b57f-4e11-ae4b-9864d89ff88e/ffff92eb850e2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787692519.715940:0:15042:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787692519.716267:0:15042:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787692519.716298:0:15042:0:(import.c:65:import_set_state_nolock()) ffff92eb850e2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787692519.716367:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:2360:x1874531108103552:12345-192.168.206.27@tcp:8:mount.lustre.0 Request processed in 569us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692519.716375:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:1.0:1787692519.716674:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:1.0:1787692519.716681:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1874531108103680:12345-192.168.206.27@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787692519.716701:0:15042:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7d44c134-b57f-4e11-ae4b-9864d89ff88e@192.168.206.27@tcp t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:1.0:1787692519.716734:0:15042:0:(genops.c:1385:class_connect()) connect: client 7d44c134-b57f-4e11-ae4b-9864d89ff88e, cookie 0x5d8b8560a09df6c0 00002000:00100000:1.0:1787692519.716742:0:15042:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7d44c134-b57f-4e11-ae4b-9864d89ff88e/ffff92ecaec5e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787692519.716749:0:15042:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787692519.717145:0:15042:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787692519.717167:0:15042:0:(import.c:65:import_set_state_nolock()) ffff92ec984df000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787692519.717196:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:2360:x1874531108103680:12345-192.168.206.27@tcp:8:mount.lustre.0 Request processed in 514us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692519.717203:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:1.0:1787692519.720560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692519.720678:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108103808 00000100:00100000:3.0:1787692519.720687:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108103808 00000100:00100000:3.0:1787692519.720780:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:3.0:1787692519.720791:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:13767:x1874531108103808:12345-192.168.206.27@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787692519.724882:0:14359:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3980us 00000004:00200000:3.0:1787692519.735838:0:14359:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787692519.736033:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:13767:x1874531108103808:12345-192.168.206.27@tcp:33:mount.lustre.0 Request processed in 15238us (15474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692519.736043:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:1.0:1787692519.889346:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692519.889456:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108103936 00000100:00100000:2.0:1787692519.889465:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108103936 00000100:00100000:2.0:1787692519.889554:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:2.0:1787692519.889565:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:13811:x1874531108103936:12345-192.168.206.27@tcp:101:mkdir.0 00010000:00010000:2.0:1787692519.889585:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692519.889610:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df6c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2664 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692519.889672:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df6ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692519.889686:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df6ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692519.889700:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df6ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787692519.890224:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787692519.890229:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787692519.890344:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df6ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692519.890371:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df6c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2664 expref: 8 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692519.890391:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df6ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2664 expref: 7 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692519.890399:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636000) 00010000:00010000:3.0:1787692519.890402:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787692519.890406:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2a00, rc 0) 00000100:00100000:3.0:1787692519.890508:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:13811:x1874531108103936:12345-192.168.206.27@tcp:101:mkdir.0 Request processed in 945us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692519.890516:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00010000:00010000:3.0:1787692520.195631:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787692520.641637:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1787692520.832548:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d44c134-b57f-4e11-ae4b-9864d89ff88e 00010000:00010000:1.0:1787692521.217103:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692521.810421:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692521.810565:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108104064 00000100:00100000:0.0:1787692521.810574:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108104064 00000100:00100000:0.0:1787692521.810643:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:0.0:1787692521.810654:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:13864:x1874531108104064:12345-192.168.206.27@tcp:41:lfs.0 00000004:00000024:0.0:1787692521.810693:0:14358:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787692521.810778:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:13864:x1874531108104064:12345-192.168.206.27@tcp:41:lfs.0 Request processed in 125us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692521.810787:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00080000:1.0:1787692521.812130:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692521.821207:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692521.821300:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108104192 00000100:00100000:2.0:1787692521.821322:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108104192 00000100:00080000:3.0:1787692521.821481:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787692521.821552:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:2.0:1787692521.821564:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d44c134-b57f-4e11-ae4b-9864d89ff88e+5:13864:x1874531108104192:12345-192.168.206.27@tcp:13:lfs.0 00002000:00000024:2.0:1787692521.821600:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692521.821679:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d44c134-b57f-4e11-ae4b-9864d89ff88e+5:13864:x1874531108104192:12345-192.168.206.27@tcp:13:lfs.0 Request processed in 117us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692521.821687:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:0.0:1787692521.846367:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692521.846464:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108104320 00000100:00100000:2.0:1787692521.846475:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108104320 00000100:00080000:0.0:1787692521.846749:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787692521.846883:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:2.0:1787692521.846933:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:13864:x1874531108104320:12345-192.168.206.27@tcp:13:lfs.0 00002000:00000024:2.0:1787692521.846975:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692521.847073:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:13864:x1874531108104320:12345-192.168.206.27@tcp:13:lfs.0 Request processed in 180us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692521.847080:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000001:00100000:3.0:1787692521.884227:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7d44c134-b57f-4e11-ae4b-9864d89ff88e 00000100:00100000:2.0:1787692522.073312:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692522.077288:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108104448 00000100:00100000:0.0:1787692522.077304:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108104448 00000100:00100000:0.0:1787692522.077439:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 89 00000100:00100000:0.0:1787692522.077450:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+10:13897:x1874531108104448:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787692522.077465:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692522.077481:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e0800/0x5d8b8560a09df6d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b266b expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692522.077508:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e0800/0x5d8b8560a09df6d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b266b expref: 11 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692522.077518:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecbc2e0800/0x5d8b8560a09df6d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b266b expref: 11 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692522.077525:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0800, rc 0) 00000100:00100000:0.0:1787692522.077581:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+11:13897:x1874531108104448:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 134us (4280us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692522.077588:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 89 00000100:00100000:0.0:1787692522.084300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692522.084845:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108104576 00000100:00100000:1.0:1787692522.084867:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108104576 00000100:00100000:1.0:1787692522.084928:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 90 00000100:00100000:1.0:1787692522.084938:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+11:13897:x1874531108104576:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787692522.085476:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+11:13897:x1874531108104576:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 536us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692522.085486:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 90 00000100:00100000:1.0:1787692522.090492:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692522.090867:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108104704 00000100:00100000:0.0:1787692522.090877:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108104704 00000100:00100000:0.0:1787692522.090973:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 91 00000100:00100000:0.0:1787692522.090983:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+11:13897:x1874531108104704:12345-192.168.206.27@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787692522.093266:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+11:13897:x1874531108104704:12345-192.168.206.27@tcp:503:mount.lustre.0 Request processed in 2273us (2772us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692522.093281:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 91 00000100:00100000:3.0:1787692522.097689:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692522.103184:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108104832 00000100:00100000:1.0:1787692522.103201:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108104832 00000100:00100000:1.0:1787692522.103263:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 92 00000100:00100000:1.0:1787692522.103274:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb847a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+11:13903:x1874531108104832:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787692522.103626:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb847a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+11:13903:x1874531108104832:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 352us (5947us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692522.103645:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 92 00000100:00100000:3.0:1787692522.124560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692522.125436:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108104960 00000100:00100000:1.0:1787692522.125447:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108104960 00000100:00100000:1.0:1787692522.125548:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 93 00000100:00100000:1.0:1787692522.125559:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec89c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+11:13903:x1874531108104960:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787692522.125880:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec89c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+11:13903:x1874531108104960:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 322us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692522.125891:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 93 00000100:00100000:3.0:1787692522.130558:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692522.130776:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108105088 00000100:00100000:2.0:1787692522.130786:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108105088 00000100:00100000:2.0:1787692522.131031:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 94 00000100:00100000:2.0:1787692522.131055:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec89c72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+11:13897:x1874531108105088:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787692522.131071:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692522.131089:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec814a3c00/0x5d8b8560a09df6dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2695 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692522.131117:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a3c00/0x5d8b8560a09df6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2695 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692522.131157:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec814a3c00/0x5d8b8560a09df6dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2695 expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692522.131166:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3c00, rc 0) 00000100:00100000:2.0:1787692522.131570:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec89c72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+12:13897:x1874531108105088:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 529us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692522.131577:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 94 00000100:00100000:3.0:1787692522.135269:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692522.135395:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108105216 00000100:00100000:1.0:1787692522.135405:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108105216 00000100:00100000:1.0:1787692522.135463:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 95 00000100:00100000:1.0:1787692522.135473:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+12:13897:x1874531108105216:12345-192.168.206.27@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787692522.135498:0:14350:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787692522.135522:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787692522.135527:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787692522.135530:0:14350:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787692522.135533:0:14350:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787692522.138040:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+12:13897:x1874531108105216:12345-192.168.206.27@tcp:256:mount.lustre.0 Request processed in 2557us (2775us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692522.138055:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 95 00000100:00100000:3.0:1787692522.141435:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692522.141540:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108105344 00000100:00100000:2.0:1787692522.141554:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108105344 00000100:00100000:2.0:1787692522.141613:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 96 00000100:00100000:2.0:1787692522.141622:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+12:13897:x1874531108105344:12345-192.168.206.27@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787692522.141637:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692522.141654:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09df6e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b269c expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692522.142475:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09df6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b269c expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692522.142490:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09df6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b269c expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692522.142500:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2e00, rc 0) 00000100:00100000:2.0:1787692522.142560:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+13:13897:x1874531108105344:12345-192.168.206.27@tcp:101:mount.lustre.0 Request processed in 938us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692522.142567:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 96 00000100:00100000:3.0:1787692522.148295:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692522.148463:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108105472 00000100:00100000:1.0:1787692522.148478:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108105472 00000100:00100000:1.0:1787692522.148569:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 97 00000100:00100000:1.0:1787692522.148580:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+13:13897:x1874531108105472:12345-192.168.206.27@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787692522.150469:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+13:13897:x1874531108105472:12345-192.168.206.27@tcp:501:mount.lustre.0 Request processed in 1879us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692522.150494:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 97 00000100:00100000:3.0:1787692522.155174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692522.155274:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108105600 00000100:00100000:2.0:1787692522.155296:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108105600 00000100:00100000:2.0:1787692522.155353:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 98 00000100:00100000:2.0:1787692522.155375:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+13:13897:x1874531108105600:12345-192.168.206.27@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787692522.155796:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+13:13897:x1874531108105600:12345-192.168.206.27@tcp:503:mount.lustre.0 Request processed in 423us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692522.155805:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 98 00000100:00100000:3.0:1787692522.167047:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692522.167189:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108105728 00000100:00100000:1.0:1787692522.167198:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108105728 00000100:00100000:1.0:1787692522.167305:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00100000:1.0:1787692522.167317:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+13:13907:x1874531108105728:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787692522.167602:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+13:13907:x1874531108105728:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 278us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692522.167741:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 99 00000100:00100000:3.0:1787692522.171723:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692522.171985:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108105856 00000100:00100000:0.0:1787692522.171995:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108105856 00000100:00100000:0.0:1787692522.172056:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 100 00000100:00100000:0.0:1787692522.172067:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+13:13907:x1874531108105856:12345-192.168.206.27@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787692522.172309:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+13:13907:x1874531108105856:12345-192.168.206.27@tcp:502:llog_process_th.0 Request processed in 243us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692522.172317:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 100 00000100:00100000:3.0:1787692522.178799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692522.179263:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108105984 00000100:00100000:0.0:1787692522.179274:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108105984 00000100:00100000:0.0:1787692522.179325:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:0.0:1787692522.179333:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1874531108105984:12345-192.168.206.27@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787692522.179359:0:14357:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 425c109c-a84e-4018-a3a5-8354840ad4df@192.168.206.27@tcp t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:0.0:1787692522.179549:0:14357:0:(genops.c:1385:class_connect()) connect: client 425c109c-a84e-4018-a3a5-8354840ad4df, cookie 0x5d8b8560a09df6ea 00000004:00100000:0.0:1787692522.179579:0:14357:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787692522.179710:0:14357:0:(import.c:65:import_set_state_nolock()) ffff92ec90fbf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787692522.179869:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:425c109c-a84e-4018-a3a5-8354840ad4df+6:2360:x1874531108105984:12345-192.168.206.27@tcp:38:mount.lustre.0 Request processed in 518us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692522.179877:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:3.0:1787692522.190180:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692522.190286:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108106240 00000100:00100000:0.0:1787692522.190296:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108106240 00000100:00100000:0.0:1787692522.190379:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:0.0:1787692522.190391:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:425c109c-a84e-4018-a3a5-8354840ad4df+6:13897:x1874531108106240:12345-192.168.206.27@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787692522.190437:0:14358:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787692522.190513:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:425c109c-a84e-4018-a3a5-8354840ad4df+6:13897:x1874531108106240:12345-192.168.206.27@tcp:41:mount.lustre.0 Request processed in 125us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692522.190537:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00080000:3.0:1787692522.190608:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787692522.194234:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692522.199154:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108106112 00000100:00100000:1.0:1787692522.199174:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108106112 00000100:00100000:1.0:1787692522.199296:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:1.0:1787692522.199307:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:425c109c-a84e-4018-a3a5-8354840ad4df+6:0:x1874531108106112:12345-192.168.206.27@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787692522.199337:0:14356:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787692522.199594:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:425c109c-a84e-4018-a3a5-8354840ad4df+6:0:x1874531108106112:12345-192.168.206.27@tcp:41:mount.lustre.0 Request processed in 288us (5368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692522.199603:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:2.0:1787692522.205972:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692522.206246:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108106368 00000100:00100000:1.0:1787692522.206257:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108106368 00000100:00100000:1.0:1787692522.206322:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:1.0:1787692522.206333:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:425c109c-a84e-4018-a3a5-8354840ad4df+6:13897:x1874531108106368:12345-192.168.206.27@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787692522.206697:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:425c109c-a84e-4018-a3a5-8354840ad4df+6:13897:x1874531108106368:12345-192.168.206.27@tcp:40:mount.lustre.0 Request processed in 363us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692522.206987:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:3.0:1787692522.211456:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692522.211496:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692522.211532:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692522.211707:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108106752 00000100:00100000:0.0:1787692522.211717:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108106752 00000100:00100000:2.0:1787692522.211726:0:15856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108106496 00000100:00100000:2.0:1787692522.211732:0:15856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108106496 00000100:00100000:2.0:1787692522.211764:0:15856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108106624 00000100:00100000:2.0:1787692522.211768:0:15856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108106624 00000100:00100000:0.0:1787692522.211772:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:0.0:1787692522.211785:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:425c109c-a84e-4018-a3a5-8354840ad4df+6:13897:x1874531108106752:12345-192.168.206.27@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787692522.211792:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:2.0:1787692522.211800:0:15856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1874531108106496:12345-192.168.206.27@tcp:8:mount.lustre.0 00000004:00200000:0.0:1787692522.212116:0:14360:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787692522.212134:0:15856:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 425c109c-a84e-4018-a3a5-8354840ad4df@192.168.206.27@tcp t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:2.0:1787692522.212175:0:15856:0:(genops.c:1385:class_connect()) connect: client 425c109c-a84e-4018-a3a5-8354840ad4df, cookie 0x5d8b8560a09df6f1 00002000:00100000:2.0:1787692522.212186:0:15856:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 425c109c-a84e-4018-a3a5-8354840ad4df/ffff92ecaf647800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787692522.212198:0:15856:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1787692522.212283:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:425c109c-a84e-4018-a3a5-8354840ad4df+6:13897:x1874531108106752:12345-192.168.206.27@tcp:33:mount.lustre.0 Request processed in 499us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692522.212292:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:0.0:1787692522.212324:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:0.0:1787692522.212330:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1874531108106624:12345-192.168.206.27@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787692522.212349:0:15040:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 425c109c-a84e-4018-a3a5-8354840ad4df@192.168.206.27@tcp t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:0.0:1787692522.212367:0:15040:0:(genops.c:1385:class_connect()) connect: client 425c109c-a84e-4018-a3a5-8354840ad4df, cookie 0x5d8b8560a09df6f8 00002000:00100000:0.0:1787692522.212373:0:15040:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 425c109c-a84e-4018-a3a5-8354840ad4df/ffff92ec90fbe800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113950 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787692522.212380:0:15040:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787692522.212674:0:15040:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787692522.212701:0:15040:0:(import.c:65:import_set_state_nolock()) ffff92ec90fbe000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787692522.212733:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:425c109c-a84e-4018-a3a5-8354840ad4df+6:2360:x1874531108106624:12345-192.168.206.27@tcp:8:mount.lustre.0 Request processed in 401us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692522.212740:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00002000:00080000:2.0:1787692522.213306:0:15856:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787692522.213326:0:15856:0:(import.c:65:import_set_state_nolock()) ffff92ecaf643800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787692522.217831:0:15856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:425c109c-a84e-4018-a3a5-8354840ad4df+6:2360:x1874531108106496:12345-192.168.206.27@tcp:8:mount.lustre.0 Request processed in 6005us (6360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692522.217861:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00010000:00010000:2.0:1787692522.241863:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692522.340164:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692522.340285:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108106880 00000100:00100000:1.0:1787692522.340308:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108106880 00000100:00100000:1.0:1787692522.340370:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:1.0:1787692522.340380:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:425c109c-a84e-4018-a3a5-8354840ad4df+6:13928:x1874531108106880:12345-192.168.206.27@tcp:101:mkdir.0 00010000:00010000:1.0:1787692522.340407:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692522.340438:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09df6ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b26c6 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692522.340500:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09df706 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692522.340513:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09df706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692522.340524:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09df706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692522.340704:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787692522.340708:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692522.340793:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09df706 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692522.340885:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164800/0x5d8b8560a09df6ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26c6 expref: 8 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692522.340903:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09df706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26c6 expref: 7 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692522.340911:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636000) 00010000:00010000:1.0:1787692522.340913:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787692522.340917:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165200, rc 0) 00000100:00100000:1.0:1787692522.340973:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:425c109c-a84e-4018-a3a5-8354840ad4df+7:13928:x1874531108106880:12345-192.168.206.27@tcp:101:mkdir.0 Request processed in 594us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692522.340980:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00010000:00010000:3.0:1787692523.265065:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692523.841938:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125921024:0@lo:400:kworker.0 00000100:00100000:1.0:1787692523.841938:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125920896:0@lo:400:kworker.0 00000100:00100000:0.0:1787692523.842036:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125921152:0@lo:400:kworker.0 00000100:00100000:0.0:1787692523.842103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692523.842158:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125921664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692523.842198:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692523.842222:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787692523.842228:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125921280:0@lo:400:kworker.0 00000100:00100000:0.0:1787692523.842253:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692523.842287:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125921664 00000100:00100000:0.0:1787692523.842294:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125921664 00000100:00100000:0.0:1787692523.842347:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787692523.842356:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125921664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787692523.842386:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692523.842430:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125921664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692523.842436:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787692523.842457:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787692523.842490:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125921664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692523.842520:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125921152 00000100:00100000:0.0:1787692523.842523:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125921152 00000100:00100000:0.0:1787692523.842554:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787692523.842560:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125921152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692523.842595:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125921152:12345-0@lo:400:kworker.0 Request processed in 35us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692523.842601:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787692523.842617:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787692523.842632:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125921152:0@lo:400:kworker.0 00000100:00100000:0.0:1787692523.842702:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125921280 00000100:00100000:0.0:1787692523.842705:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125921280 00000100:00100000:0.0:1787692523.842732:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787692523.842739:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125921280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692523.842782:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125921280:12345-0@lo:400:kworker.0 Request processed in 43us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692523.842789:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787692523.842837:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125921280:0@lo:400:kworker.0 00000100:00100000:3.0:1787692523.843195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692523.843217:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125921536:0@lo:400:kworker.0 00000100:00100000:3.0:1787692523.843239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692523.844497:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125921024 00000100:00100000:0.0:1787692523.844510:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125921024 00000100:00100000:0.0:1787692523.844574:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787692523.844596:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125921024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692523.844673:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125921024:12345-0@lo:400:kworker.0 Request processed in 90us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692523.844680:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787692523.844703:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125921536 00000100:00100000:0.0:1787692523.844708:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125921536 00000100:00100000:0.0:1787692523.844740:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787692523.844747:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125921536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692523.844779:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125921536:12345-0@lo:400:kworker.0 Request processed in 33us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692523.844785:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787692523.844800:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692523.844864:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125921024:0@lo:400:kworker.0 00000100:00100000:0.0:1787692523.844878:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125921536:0@lo:400:kworker.0 00000100:00100000:1.0:1787692523.844933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692523.844969:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125921408:0@lo:400:kworker.0 00000100:00100000:1.0:1787692523.845001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692523.845032:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125920896 00000100:00100000:1.0:1787692523.845036:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125920896 00000100:00100000:1.0:1787692523.845062:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787692523.845067:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:3304:x1874531125920896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692523.845102:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:3304:x1874531125920896:12345-0@lo:400:kworker.0 Request processed in 34us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692523.845109:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787692523.845137:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125921408 00000100:00100000:1.0:1787692523.845141:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125921408 00000100:00100000:1.0:1787692523.845166:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787692523.845171:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125921408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787692523.845199:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874531125921408:12345-0@lo:400:kworker.0 Request processed in 27us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692523.845212:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787692523.845226:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692523.845242:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125920896:0@lo:400:kworker.0 00000100:00100000:1.0:1787692523.845252:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874531125921408:0@lo:400:kworker.0 00000100:00100000:2.0:1787692523.845576:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125921792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787692523.845622:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692523.845665:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125921792 00000100:00100000:2.0:1787692523.845669:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125921792 00000100:00100000:2.0:1787692523.845695:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787692523.845702:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125921792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787692523.845728:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692523.845764:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125921792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692523.845769:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787692523.845800:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125921792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787692524.288966:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787692524.815725:0:16317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1787692524.925164:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 425c109c-a84e-4018-a3a5-8354840ad4df 00000001:00100000:2.0:1787692524.925183:0:5853:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7d44c134-b57f-4e11-ae4b-9864d89ff88e 00010000:00010000:2.0:1787692525.313253:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787692525.958195:0:6703:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 425c109c-a84e-4018-a3a5-8354840ad4df 00010000:00010000:0.0:1787692526.340266:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787692527.036542:0:7630:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 425c109c-a84e-4018-a3a5-8354840ad4df 00000100:00100000:3.0:1787692527.265377:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692527.265428:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692527.265528:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108107008 00000100:00100000:1.0:1787692527.265541:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108107008 00000100:00100000:1.0:1787692527.265607:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 102 00000100:00100000:1.0:1787692527.265619:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+13:2363:x1874531108107008:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692527.265711:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+13:2363:x1874531108107008:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692527.265720:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 102 00000100:00100000:3.0:1787692527.266102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692527.266135:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692527.266169:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108107520 00000100:00100000:1.0:1787692527.266174:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108107520 00000100:00100000:1.0:1787692527.266228:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:1.0:1787692527.266236:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:425c109c-a84e-4018-a3a5-8354840ad4df+6:2363:x1874531108107520:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692527.266280:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:425c109c-a84e-4018-a3a5-8354840ad4df+6:2363:x1874531108107520:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 45us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692527.266287:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00080000:1.0:1787692527.266306:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787692527.266702:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692527.266740:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692527.266796:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108107264 00000100:00100000:0.0:1787692527.266802:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108107264 00000100:00100000:0.0:1787692527.266876:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108107776 00000100:00100000:0.0:1787692527.266890:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108107776 00000100:00100000:0.0:1787692527.266924:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:0.0:1787692527.266933:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+5:2363:x1874531108107264:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692527.266989:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+5:2363:x1874531108107264:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 57us (1560us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692527.266997:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:0.0:1787692527.267013:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:0.0:1787692527.267020:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:425c109c-a84e-4018-a3a5-8354840ad4df+5:2363:x1874531108107776:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692527.267046:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:425c109c-a84e-4018-a3a5-8354840ad4df+5:2363:x1874531108107776:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 26us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692527.267053:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:0.0:1787692527.267094:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108107136 00000100:00100000:0.0:1787692527.267098:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108107136 00000100:00100000:0.0:1787692527.267123:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:0.0:1787692527.267130:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:2363:x1874531108107136:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692527.267156:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:2363:x1874531108107136:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 27us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692527.267162:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00080000:0.0:1787692527.267176:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787692527.267180:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787692527.267182:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787692527.269340:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692527.269380:0:15856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108107392 00000100:00100000:3.0:1787692527.269389:0:15856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108107392 00000100:00100000:3.0:1787692527.269456:0:15856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108107648 00000100:00100000:3.0:1787692527.269460:0:15856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108107648 00000100:00100000:3.0:1787692527.269481:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:3.0:1787692527.269492:0:15856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d44c134-b57f-4e11-ae4b-9864d89ff88e+5:2363:x1874531108107392:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692527.269567:0:15856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d44c134-b57f-4e11-ae4b-9864d89ff88e+5:2363:x1874531108107392:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 76us (2825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692527.269575:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:3.0:1787692527.269592:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:3.0:1787692527.269601:0:15856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:425c109c-a84e-4018-a3a5-8354840ad4df+5:2363:x1874531108107648:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692527.269627:0:15856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:425c109c-a84e-4018-a3a5-8354840ad4df+5:2363:x1874531108107648:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 29us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692527.269634:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00080000:3.0:1787692527.269659:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787692527.269663:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787692527.361452:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692528.388285:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787692528.567922:0:16469:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe96298d20 20000000:00000080:0.0:1787692528.567939:0:16469:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff92eb84c4e400 uarg=0000000000000000 20000000:01000000:0.0:1787692528.567979:0:16469:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787692528.567985:0:16469:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787692528.567997:0:16469:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1787692528.571042:0:16470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1787692528.571674:0:16469:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787692528.583389:0:16469:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787692528.583419:0:16469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.583437:0:16469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09df404 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df3fd expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.583445:0:16469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec88164400/0x5d8b8560a09df451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df44a expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.583452:0:16469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec88164a00/0x5d8b8560a09df4c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df4ba expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.583462:0:16469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ecbc2e1800/0x5d8b8560a09df6ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b263a expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.583469:0:16469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09df6e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b269c expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.583475:0:16469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.583521:0:16469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09df6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b269c expref: 12 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.583536:0:16469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09df6e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b269c expref: 12 pid: 14349 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692528.584384:0:16469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf71e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16469:1874531125921920:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692528.585172:0:16469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ecbc2e1800/0x5d8b8560a09df6ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b263a expref: 12 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692528.585188:0:16469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ecbc2e1800/0x5d8b8560a09df6ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b263a expref: 12 pid: 14351 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692528.585201:0:16469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16469:1874531125922048:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692528.585251:0:16469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec88164a00/0x5d8b8560a09df4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09df4ba expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692528.585273:0:16469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ec88164a00/0x5d8b8560a09df4c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09df4ba expref: 18 pid: 14351 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692528.585283:0:16469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16469:1874531125922176:0@lo:104: 00000100:00100000:1.0:1787692528.585325:0:16469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787692528.585370:0:16469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec88164400/0x5d8b8560a09df451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09df44a expref: 18 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692528.585379:0:16469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ec88164400/0x5d8b8560a09df451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09df44a expref: 18 pid: 14350 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692528.585387:0:16469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16469:1874531125922304:0@lo:104: 00000100:00100000:1.0:1787692528.585409:0:16469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787692528.585442:0:16469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09df404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5d8b8560a09df3fd expref: 18 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692528.585449:0:16469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09df404 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5d8b8560a09df3fd expref: 18 pid: 14349 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692528.585456:0:16469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16469:1874531125922432:0@lo:104: 00000100:00100000:1.0:1787692528.585478:0:16469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692528.585488:0:16469:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec904009c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692528.585542:0:14339:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787692528.585556:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125922176 00000100:00100000:3.0:1787692528.585563:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125922176 00000100:00100000:3.0:1787692528.585598:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125922304 00000100:00100000:3.0:1787692528.585601:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125922304 00000100:00100000:3.0:1787692528.585610:0:14339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125922432 00000100:00100000:3.0:1787692528.585612:0:14339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125922432 00000100:00100000:3.0:1787692528.585626:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787692528.585635:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+5:16469:x1874531125922176:12345-0@lo:104: 00010000:00010000:3.0:1787692528.585648:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df4c1 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.585723:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787692528.585729:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+5:16469:x1874531125922176:12345-0@lo:104: Request processed in 95us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692528.585737:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787692528.585756:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787692528.585760:0:15864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787692528.585763:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+4:16469:x1874531125922304:12345-0@lo:104: 00010000:00010000:2.0:1787692528.585769:0:15864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df4c1 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.585773:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df451 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692528.585791:0:15864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a400 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:2.0:1787692528.585797:0:15864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09df4c1 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692528.585807:0:15864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09df4c1 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.585843:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:2.0:1787692528.585850:0:15864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09df4c1 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692528.585851:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+4:16469:x1874531125922304:12345-0@lo:104: Request processed in 89us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692528.585866:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 10000000:01000000:2.0:1787692528.585866:0:15864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1787692528.585883:0:14339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787692528.585891:0:14339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5326850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+3:16469:x1874531125922432:12345-0@lo:104: 00010000:00010000:3.0:1787692528.585899:0:14339:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df404 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692528.585906:0:15864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df4c1 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692528.585921:0:15864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787692528.585938:0:14339:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787692528.585945:0:14339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5326850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:25c21df9-20cc-4624-87d0-9b55ad554e5c+3:16469:x1874531125922432:12345-0@lo:104: Request processed in 55us (465us total) trans 0 rc 0/0 00010000:00010000:2.0:1787692528.585949:0:15864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df4c1 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692528.585954:0:14339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1787692528.585962:0:15864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a400/0x5d8b8560a09df4ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df4c1 expref: -99 pid: 15755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692528.585977:0:15864:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787692528.585980:0:15864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df451 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692528.585986:0:15864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b600 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:2.0:1787692528.585990:0:15864:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09df451 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692528.585996:0:15864:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09df451 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.585998:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787692528.586006:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5d8b8560a09df404 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787692528.586008:0:15864:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09df451 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787692528.586025:0:15864:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787692528.586026:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a200 already unused, calling callback (ffffffffc1b51c20) 10000000:00010000:3.0:1787692528.586037:0:14344:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5d8b8560a09df404 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692528.586040:0:15864:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df451 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.586052:0:14344:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5d8b8560a09df404 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692528.586053:0:15864:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787692528.586061:0:15864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df451 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787692528.586063:0:14344:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5d8b8560a09df404 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692528.586079:0:14344:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787692528.586079:0:15864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec8b35b600/0x5d8b8560a09df44a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df451 expref: -99 pid: 15038 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692528.586097:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692528.586098:0:14344:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df404 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692528.586100:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692528.586104:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692528.586106:0:14344:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787692528.586127:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df404 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692528.586130:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125922560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692528.586141:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.127@tcp lock: ffff92ec8b35a200/0x5d8b8560a09df3fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5d8b8560a09df404 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.586157:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692528.586160:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692528.586162:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787692528.586170:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692528.586171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692528.586182:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25c21df9-20cc-4624-87d0-9b55ad554e5c:3306:1874531125922816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787692528.586199:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787692528.586207:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125922688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787692528.586214:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692528.587495:0:16469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16469:1874531125922176:0@lo:104: 00000100:00100000:1.0:1787692528.587510:0:16469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16469:1874531125922304:0@lo:104: 00000100:00100000:1.0:1787692528.587519:0:16469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16469:1874531125922432:0@lo:104: 00000100:00100000:3.0:1787692528.595592:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125922560 00000100:00100000:3.0:1787692528.595606:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125922560 00010000:00010000:3.0:1787692528.595653:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec88164a00/0x5d8b8560a09df4c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df4ba expref: 19 pid: 14351 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692528.595705:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125922816 00000100:00100000:3.0:1787692528.595709:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125922816 00010000:00010000:3.0:1787692528.595723:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09df404 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df3fd expref: 20 pid: 14349 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692528.595739:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787692528.595748:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25c21df9-20cc-4624-87d0-9b55ad554e5c+20:3304:x1874531125922560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692528.595762:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692528.595767:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec88164a00/0x5d8b8560a09df4c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df4ba expref: 20 pid: 14351 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.595779:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec88164a00/0x5d8b8560a09df4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09df4ba expref: 20 pid: 14351 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.595798:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec88164a00/0x5d8b8560a09df4c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09df4ba expref: 20 pid: 14351 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.595839:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692528.595896:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:3304:x1874531125922560:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (9725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692528.595904:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787692528.595923:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787692528.595929:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:3306:x1874531125922816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692528.595937:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692528.595941:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09df404 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df3fd expref: 18 pid: 14349 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.595949:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09df404 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09df3fd expref: 18 pid: 14349 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.595969:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a3600/0x5d8b8560a09df404 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09df3fd expref: 18 pid: 14349 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.595979:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692528.596019:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:3306:x1874531125922816:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (9804us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692528.596025:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787692528.596278:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:25c21df9-20cc-4624-87d0-9b55ad554e5c:3306:1874531125922816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787692528.597369:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692528.597424:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125922560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787692528.600005:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125922688 00000100:00100000:3.0:1787692528.600018:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125922688 00010000:00010000:3.0:1787692528.600280:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec88164400/0x5d8b8560a09df451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df44a expref: 17 pid: 14350 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692528.601499:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787692528.601519:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb8520e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:3304:x1874531125922688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787692528.601539:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692528.601548:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec88164400/0x5d8b8560a09df451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5d8b8560a09df44a expref: 17 pid: 14350 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.601561:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec88164400/0x5d8b8560a09df451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5d8b8560a09df44a expref: 17 pid: 14350 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.601579:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec88164400/0x5d8b8560a09df451 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5d8b8560a09df44a expref: 17 pid: 14350 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.601594:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692528.601676:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb8520e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:3304:x1874531125922688:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (4310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692528.601735:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:25c21df9-20cc-4624-87d0-9b55ad554e5c:3304:1874531125922688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787692528.603677:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787692528.606486:0:16469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf71e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16469:1874531125921920:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692528.606517:0:16469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16469:1874531125922048:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692528.606557:0:16469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692528.607335:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692528.607523:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108107904 00000100:00100000:3.0:1787692528.607532:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108107904 00010000:00010000:3.0:1787692528.607566:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09df6e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b269c expref: 13 pid: 14349 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692528.607602:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:3.0:1787692528.607612:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b7addca-b783-44df-be6e-98e7ff20be97+13:2361:x1874531108107904:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692528.607625:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692528.607631:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09df6e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b269c expref: 13 pid: 14349 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.607643:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09df6e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b269c expref: 13 pid: 14349 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.607660:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ec814a2e00/0x5d8b8560a09df6e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b269c expref: 13 pid: 14349 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692528.607675:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692528.607768:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4b7addca-b783-44df-be6e-98e7ff20be97+12:2361:x1874531108107904:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 157us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692528.607777:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:1.0:1787692528.608761:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692528.609697:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108108032 00000100:00100000:0.0:1787692528.609707:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108108032 00010000:00010000:0.0:1787692528.609741:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92ecbc2e1800/0x5d8b8560a09df6ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b263a expref: 12 pid: 14351 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692528.609884:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:0.0:1787692528.609895:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b7addca-b783-44df-be6e-98e7ff20be97+12:2361:x1874531108108032:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692528.609907:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692528.609913:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92ecbc2e1800/0x5d8b8560a09df6ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b263a expref: 12 pid: 14351 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.609925:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92ecbc2e1800/0x5d8b8560a09df6ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b263a expref: 12 pid: 14351 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.609940:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecbc2e1800/0x5d8b8560a09df6ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b263a expref: 12 pid: 14351 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.609953:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.609960:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.609976:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.609982:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.609987:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.610007:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.610013:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0c00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:0.0:1787692528.610017:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.610024:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.610046:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692528.610057:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692528.610176:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4b7addca-b783-44df-be6e-98e7ff20be97+11:2361:x1874531108108032:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 282us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692528.610185:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00010000:00010000:1.0:1787692528.610333:0:16469:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692528.610342:0:16469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692528.610348:0:16469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92ecbc2e0c00/0x5d8b8560a09df70d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692528.961466:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787692528.961491:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125922944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787692528.961561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692528.961762:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125922944 00000100:00100000:0.0:1787692528.961770:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125922944 00000100:00100000:0.0:1787692528.961880:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787692528.961886:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787692528.961893:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125922944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787692528.961926:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692528.961984:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125922944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692528.961992:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787692528.962049:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125922944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787692528.963974:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125923328:0@lo:400:kworker.0 00000100:00100000:2.0:1787692528.964037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692528.964075:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787692528.964081:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125923456:0@lo:400:kworker.0 00000100:00100000:2.0:1787692528.964106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692528.964195:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125923200:0@lo:400:kworker.0 00000100:00100000:0.0:1787692528.964228:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692528.964285:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1787692528.964291:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25c21df9-20cc-4624-87d0-9b55ad554e5c:3305:1874531125923072:0@lo:400:kworker.0 00000100:00100000:0.0:1787692528.964320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692528.964342:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec903b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125923584:0@lo:400:kworker.0 00000100:00100000:0.0:1787692528.964363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692528.964391:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125923328 00000100:00100000:0.0:1787692528.964398:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125923328 00000100:00100000:0.0:1787692528.964431:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125923456 00000100:00100000:0.0:1787692528.964434:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125923456 00000100:00100000:0.0:1787692528.964467:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125923584 00000100:00100000:0.0:1787692528.964470:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125923584 00000100:00100000:0.0:1787692528.964487:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787692528.964495:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125923328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692528.964546:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874531125923328:12345-0@lo:400:kworker.0 Request processed in 52us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692528.964554:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787692528.964570:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787692528.964577:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125923456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692528.964605:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874531125923456:12345-0@lo:400:kworker.0 Request processed in 30us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692528.964610:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787692528.964622:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787692528.964627:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125923584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692528.964655:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874531125923584:12345-0@lo:400:kworker.0 Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692528.964661:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787692528.964679:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125923072 00000100:00100000:0.0:1787692528.964689:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125923072 00000100:00100000:0.0:1787692528.964713:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787692528.964718:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:3305:x1874531125923072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787692528.964748:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:3305:x1874531125923072:12345-0@lo:400:kworker.0 Request processed in 29us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692528.964754:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1787692528.964782:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692528.964808:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25c21df9-20cc-4624-87d0-9b55ad554e5c:3305:1874531125923072:0@lo:400:kworker.0 00000100:00100000:0.0:1787692528.964860:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874531125923584:0@lo:400:kworker.0 00000100:00100000:0.0:1787692528.964892:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874531125923456:0@lo:400:kworker.0 00000100:00100000:0.0:1787692528.964901:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874531125923328:0@lo:400:kworker.0 00000100:00100000:2.0:1787692528.965601:0:15856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125923200 00000100:00100000:2.0:1787692528.965608:0:15856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125923200 00000100:00100000:2.0:1787692528.965663:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787692528.965670:0:15856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125923200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692528.965717:0:15856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125923200:12345-0@lo:400:kworker.0 Request processed in 48us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692528.965723:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787692528.966191:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787692528.966229:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec903b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125923200:0@lo:400:kworker.0 00000100:00100000:1.0:1787692528.967022:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787692528.967037:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125923712:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787692528.967082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692528.967473:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125923712 00000100:00100000:2.0:1787692528.967481:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125923712 00000100:00100000:2.0:1787692528.967534:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787692528.967541:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125923712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787692528.967572:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787692528.967719:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874531125923712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 177us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692528.967726:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787692528.970662:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874531125923712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787692529.409121:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787692530.085457:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692530.085541:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108108160 00000100:00100000:0.0:1787692530.085552:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108108160 00000100:00100000:0.0:1787692530.085608:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 104 00000100:00100000:0.0:1787692530.085617:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+11:13781:x1874531108108160:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692530.085635:0:14350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692530.085655:0:14350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e1200/0x5d8b8560a09df714 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b26cd expref: -99 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692530.085683:0:14350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e1200/0x5d8b8560a09df714 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26cd expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692530.085696:0:14350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecbc2e1200/0x5d8b8560a09df714 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26cd expref: 12 pid: 14350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692530.085719:0:14350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1200, rc 0) 00000100:00100000:0.0:1787692530.085771:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+12:13781:x1874531108108160:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 155us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692530.085778:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 104 00000100:00100000:2.0:1787692530.098385:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692530.098560:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108108288 00000100:00100000:1.0:1787692530.098570:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108108288 00000100:00100000:1.0:1787692530.098670:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 105 00000100:00100000:1.0:1787692530.098680:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+12:13781:x1874531108108288:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692530.098978:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+12:13781:x1874531108108288:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 299us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692530.098987:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 105 00000100:00100000:1.0:1787692530.101021:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692530.101117:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108108416 00000100:00100000:0.0:1787692530.101127:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108108416 00000100:00100000:0.0:1787692530.101210:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 106 00000100:00100000:0.0:1787692530.101220:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+12:13781:x1874531108108416:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787692530.101483:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+12:13781:x1874531108108416:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 264us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692530.101491:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 106 00000100:00100000:3.0:1787692530.105888:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692530.105977:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108108544 00000100:00100000:1.0:1787692530.105987:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108108544 00000100:00100000:1.0:1787692530.106039:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 107 00000100:00100000:1.0:1787692530.106049:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+12:13781:x1874531108108544:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787692530.106066:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692530.106084:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec88165000/0x5d8b8560a09df71b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b26d4 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692530.106111:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec88165000/0x5d8b8560a09df71b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26d4 expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692530.106122:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec88165000/0x5d8b8560a09df71b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26d4 expref: 13 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692530.106131:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165000, rc 0) 00000100:00100000:1.0:1787692530.106184:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+13:13781:x1874531108108544:12345-192.168.206.27@tcp:101:ll_cfg_requeue.0 Request processed in 136us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692530.106191:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 107 00000100:00100000:2.0:1787692530.110389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692530.110618:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108108672 00000100:00100000:0.0:1787692530.110628:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108108672 00000100:00100000:0.0:1787692530.110747:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 108 00000100:00100000:0.0:1787692530.110759:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+13:13781:x1874531108108672:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787692530.111106:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4b7addca-b783-44df-be6e-98e7ff20be97+13:13781:x1874531108108672:12345-192.168.206.27@tcp:501:ll_cfg_requeue.0 Request processed in 348us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692530.111116:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 108 00000100:00100000:2.0:1787692530.115302:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692530.115587:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108108800 00000100:00100000:0.0:1787692530.115597:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108108800 00000100:00100000:0.0:1787692530.115656:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 109 00000100:00100000:0.0:1787692530.115667:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+13:13781:x1874531108108800:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787692530.115932:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4b7addca-b783-44df-be6e-98e7ff20be97+13:13781:x1874531108108800:12345-192.168.206.27@tcp:503:ll_cfg_requeue.0 Request processed in 266us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692530.115951:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 109 00010000:00010000:2.0:1787692530.433023:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787692530.562258:0:14354:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787692530.562265:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ec984de000 from 10 10000000:01000000:3.0:1787692530.562272:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787692530.562473:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09df722 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692530.562485:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09df722 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692530.562496:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09df722 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692530.562520:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125923840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787692530.562585:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692530.562634:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb22aae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787692530.562706:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125923840 00000100:00100000:0.0:1787692530.562714:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125923840 00000100:00100000:0.0:1787692530.562770:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787692530.562780:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+16:14354:x1874531125923840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692530.562792:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692530.562837:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e0000/0x5d8b8560a09df729 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df722 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692530.562861:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e0000/0x5d8b8560a09df729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df722 expref: 17 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692530.562872:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecbc2e0000/0x5d8b8560a09df729 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df722 expref: 17 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692530.562881:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0000, rc 0) 00000100:00100000:0.0:1787692530.562925:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:14354:x1874531125923840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692530.562932:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787692530.564888:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125923840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787692530.564922:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09df722 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df729 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692530.564934:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09df722 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df729 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692530.565051:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125923968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787692530.565113:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692530.565152:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb85fda780 going to sleep for 11 seconds 00000100:00100000:1.0:1787692530.565258:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125923968 00000100:00100000:1.0:1787692530.565264:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125923968 00000100:00100000:1.0:1787692530.565300:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787692530.565308:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:14354:x1874531125923968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692530.565542:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:14354:x1874531125923968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692530.565550:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787692530.567069:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125923968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787692530.567120:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787692530.567178:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692530.567218:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb85fda780 going to sleep for 11 seconds 00000100:00100000:1.0:1787692530.567270:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125924096 00000100:00100000:1.0:1787692530.567276:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125924096 00000100:00100000:1.0:1787692530.567330:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787692530.567339:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:14354:x1874531125924096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692530.567512:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:14354:x1874531125924096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692530.567520:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787692530.567737:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787692530.568740:0:16562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787692530.569002:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787692530.569020:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787692530.569030:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09df722 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df729 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692530.569042:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec814a2c00/0x5d8b8560a09df722 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df729 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787692530.569052:0:14354:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787692530.569055:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92eb850d5800 from 10 10000000:01000000:3.0:1787692530.569058:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787692530.569092:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88b14e00/0x5d8b8560a09df730 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692530.569107:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec88b14e00/0x5d8b8560a09df730 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692530.569119:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec88b14e00/0x5d8b8560a09df730 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692530.569143:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787692530.569201:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692530.569236:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92eb85fda780 going to sleep for 11 seconds 00000100:00100000:0.0:1787692530.569378:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125924224 00000100:00100000:0.0:1787692530.569383:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125924224 00000100:00100000:0.0:1787692530.569429:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787692530.569438:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+17:14354:x1874531125924224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787692530.569452:0:14351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692530.569464:0:14351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ecbc2e1a00/0x5d8b8560a09df737 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df730 expref: -99 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692530.569485:0:14351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ecbc2e1a00/0x5d8b8560a09df737 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df730 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692530.569504:0:14351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ecbc2e1a00/0x5d8b8560a09df737 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df730 expref: 18 pid: 14351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692530.569512:0:14351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1a00, rc 0) 00000100:00100000:0.0:1787692530.569559:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:14354:x1874531125924224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692530.569566:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787692530.569647:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ec878b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787692530.569664:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec88b14e00/0x5d8b8560a09df730 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df737 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692530.569675:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec88b14e00/0x5d8b8560a09df730 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df737 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692530.569738:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692530.569771:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692530.569799:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb22aae40 going to sleep for 11 seconds 00000100:00100000:0.0:1787692530.570190:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125924352 00000100:00100000:0.0:1787692530.570196:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125924352 00000100:00100000:0.0:1787692530.570233:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1787692530.570241:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:14354:x1874531125924352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787692530.570475:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:14354:x1874531125924352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692530.570482:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787692530.570568:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787692530.570600:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787692530.570642:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692530.570665:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb22aae40 going to sleep for 11 seconds 00000100:00100000:1.0:1787692530.570924:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125924480 00000100:00100000:1.0:1787692530.570929:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125924480 00000100:00100000:1.0:1787692530.570966:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787692530.570974:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:14354:x1874531125924480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692530.571332:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:14354:x1874531125924480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 358us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692530.571340:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787692530.571388:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787692530.572054:0:16564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787692530.572104:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787692530.572121:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787692530.572130:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88b14e00/0x5d8b8560a09df730 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df737 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692530.572140:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec88b14e00/0x5d8b8560a09df730 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df737 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787692530.572151:0:14354:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787692530.572154:0:14354:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff92ec88172800 from 10 10000000:01000000:1.0:1787692530.572157:0:14354:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787692530.572184:0:14354:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88164800/0x5d8b8560a09df73e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692530.572205:0:14354:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.127@tcp lock: ffff92ec88164800/0x5d8b8560a09df73e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692530.572215:0:14354:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.127@tcp lock: ffff92ec88164800/0x5d8b8560a09df73e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692530.572232:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787692530.572272:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692530.572304:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9050d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692530.572322:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125924608 00000100:00100000:1.0:1787692530.572326:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125924608 00000100:00100000:1.0:1787692530.572355:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787692530.572363:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+18:14354:x1874531125924608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787692530.572372:0:14349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692530.572383:0:14349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92ec88164200/0x5d8b8560a09df745 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5d8b8560a09df73e expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692530.572403:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92ec88164200/0x5d8b8560a09df745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5d8b8560a09df73e expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692530.572412:0:14349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92ec88164200/0x5d8b8560a09df745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5d8b8560a09df73e expref: 19 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692530.572420:0:14349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164200, rc 0) 00000100:00100000:1.0:1787692530.572450:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:14354:x1874531125924608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692530.572456:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787692530.572499:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787692530.572512:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.127@tcp lock: ffff92ec88164800/0x5d8b8560a09df73e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df745 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692530.572520:0:14354:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.127@tcp lock: ffff92ec88164800/0x5d8b8560a09df73e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5d8b8560a09df745 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692530.572560:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692530.572587:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692530.572600:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9050d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692530.572611:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125924736 00000100:00100000:1.0:1787692530.572614:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125924736 00000100:00100000:1.0:1787692530.572635:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787692530.572641:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:14354:x1874531125924736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692530.572879:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:14354:x1874531125924736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692530.572886:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787692530.572917:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787692530.572942:0:14354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692530.572978:0:14354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692530.572997:0:14354:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9050d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692530.573006:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125924864 00000100:00100000:1.0:1787692530.573009:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125924864 00000100:00100000:1.0:1787692530.573028:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787692530.573034:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:14354:x1874531125924864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787692530.573168:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:14354:x1874531125924864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692530.573180:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787692530.573215:0:14354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:25c21df9-20cc-4624-87d0-9b55ad554e5c:14354:1874531125924864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787692530.575650:0:16565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787692530.575842:0:14354:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787692530.575862:0:14354:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.127@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787692530.575872:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.127@tcp lock: ffff92ec88164800/0x5d8b8560a09df73e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df745 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692530.575883:0:14354:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.127@tcp lock: ffff92ec88164800/0x5d8b8560a09df73e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5d8b8560a09df745 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787692530.881446:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787692531.457133:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692531.775009:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692531.775288:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108108928 00000100:00100000:0.0:1787692531.775309:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108108928 00000100:00100000:0.0:1787692531.775391:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:0.0:1787692531.775401:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:14438:x1874531108108928:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787692531.775420:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692531.775443:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1e00/0x5d8b8560a09df74c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b26db expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.775505:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df753 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.775517:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.775540:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.775554:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df75a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.775560:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.775567:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787692531.775970:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787692531.777209:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df761 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777228:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df761 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777239:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df761 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692531.777415:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787692531.777419:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692531.777516:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df761 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777528:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df753 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777535:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df753 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777552:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df753 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777557:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692531.777562:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df753 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777570:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df753 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777583:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636000) 00010000:00010000:0.0:1787692531.777586:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692531.777590:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df753 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777596:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df753 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777608:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df75a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777614:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df75a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777619:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df75a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777624:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692531.777627:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df75a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777642:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df75a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777651:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff92ec832f4f00) 00010000:00010000:0.0:1787692531.777653:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692531.777657:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df75a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777662:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df75a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777701:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1e00/0x5d8b8560a09df74c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26db expref: 8 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777714:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0a00/0x5d8b8560a09df761 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26db expref: 7 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.777721:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92ec832f4300) 00010000:00010000:0.0:1787692531.777723:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787692531.777725:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e0a00, rc 0) 00000100:00100000:0.0:1787692531.779951:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:14438:x1874531108108928:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 4540us (4939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692531.779965:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:3.0:1787692531.785241:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692531.785361:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108109184 00000100:00100000:1.0:1787692531.785383:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108109184 00000100:00100000:1.0:1787692531.785444:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:1.0:1787692531.785631:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:14438:x1874531108109184:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787692531.785653:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692531.785682:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df768 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b26e2 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.785758:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df76f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.785781:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df76f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.785792:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df76f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.785879:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df776 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.785888:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df776 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.785895:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df776 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.786359:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09df77d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.786369:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09df77d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.786744:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09df77d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692531.786755:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787692531.787165:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df76f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.787174:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df76f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.787180:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df76f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.787185:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692531.787190:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df76f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.787197:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df76f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.787209:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff92ec832f4300) 00010000:00010000:1.0:1787692531.787213:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692531.787217:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df76f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.787234:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df76f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.787248:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df776 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.787254:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df776 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.787261:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df776 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.787266:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692531.787269:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df776 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.787275:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df776 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.787283:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff92ec9dbfad00) 00010000:00010000:1.0:1787692531.787286:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692531.787288:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df776 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.787294:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df776 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.788333:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df768 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26e2 expref: 10 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.788448:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165800/0x5d8b8560a09df77d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26e2 expref: 9 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.788529:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:1.0:1787692531.788533:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692531.788536:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88165800, rc 0) 00000100:00100000:1.0:1787692531.788607:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+9:14438:x1874531108109184:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 3152us (3376us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787692531.788616:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:2.0:1787692531.802905:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692531.802995:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108109312 00000100:00100000:0.0:1787692531.803005:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108109312 00000100:00100000:0.0:1787692531.803060:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:0.0:1787692531.803071:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+9:14438:x1874531108109312:12345-192.168.206.27@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787692531.803189:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+9:14438:x1874531108109312:12345-192.168.206.27@tcp:59:lhsmtool_posix.0 Request processed in 118us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692531.803196:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 17 00000100:00100000:3.0:1787692531.871953:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692531.872271:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108109440 00000100:00100000:1.0:1787692531.872280:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108109440 00000100:00100000:1.0:1787692531.872336:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:1.0:1787692531.872346:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+9:14444:x1874531108109440:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692531.872366:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692531.872731:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df78b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b26e9 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.872843:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df792 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.872856:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df792 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.872869:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df792 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.872884:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df799 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.872909:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.872917:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873519:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df792 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873528:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df792 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873534:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df792 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873539:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164e00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692531.873543:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df792 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873550:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df792 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873562:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636000) 00010000:00010000:1.0:1787692531.873565:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692531.873568:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873574:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873585:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df799 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873597:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df799 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873602:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df799 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873606:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692531.873609:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df799 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873616:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df799 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873624:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92ec9dbfad00) 00010000:00010000:1.0:1787692531.873627:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692531.873630:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df799 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873636:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df799 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873741:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df78b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26e9 expref: 10 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873752:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636000) 00010000:00010000:1.0:1787692531.873754:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692531.873758:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df78b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26e9 expref: 10 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.873927:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164400, rc 0) 00000100:00100000:1.0:1787692531.874022:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+9:14444:x1874531108109440:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 1676us (2077us total) trans 0 rc 301/301 00000100:00100000:1.0:1787692531.874030:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 18 00000100:00100000:3.0:1787692531.881860:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692531.882721:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108109568 00000100:00100000:0.0:1787692531.882732:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108109568 00000100:00100000:0.0:1787692531.882907:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:0.0:1787692531.882917:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+9:14444:x1874531108109568:12345-192.168.206.27@tcp:700:lfs.0 00000100:00100000:0.0:1787692531.883005:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+9:14444:x1874531108109568:12345-192.168.206.27@tcp:700:lfs.0 Request processed in 83us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692531.883013:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:3.0:1787692531.885972:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692531.886300:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108109824 00000100:00100000:1.0:1787692531.886309:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108109824 00000100:00100000:1.0:1787692531.886366:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 19 00000100:00100000:1.0:1787692531.886385:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+9:14444:x1874531108109824:12345-192.168.206.27@tcp:36:lfs.0 00010000:00010000:1.0:1787692531.886445:0:14357:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692531.886469:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df6ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2664 expref: 9 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.886491:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636000) 00010000:00010000:1.0:1787692531.886496:0:14357:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787692531.887266:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.887284:0:14357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09df706 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26c6 expref: 5 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.887292:0:14357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.887326:0:14357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09df706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26c6 expref: 5 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.887339:0:14357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09df706 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26c6 expref: 5 pid: 14356 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692531.887360:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1874531125924992:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692531.887562:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9050d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692531.890980:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692531.891271:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1874531125924992:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692531.891297:0:14357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692531.891369:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108109952 00000100:00100000:0.0:1787692531.891376:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108109952 00010000:00010000:0.0:1787692531.891590:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09df706 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26c6 expref: 6 pid: 14356 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787692531.891942:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692531.892277:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:0.0:1787692531.892292:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425c109c-a84e-4018-a3a5-8354840ad4df+6:2362:x1874531108109952:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692531.892307:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692531.892315:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09df706 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26c6 expref: 6 pid: 14356 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.892328:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09df706 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26c6 expref: 6 pid: 14356 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.892348:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88165200/0x5d8b8560a09df706 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26c6 expref: 6 pid: 14356 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.893768:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636000) 00010000:00010000:0.0:1787692531.893778:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.893789:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.893808:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.893859:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692531.893923:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:425c109c-a84e-4018-a3a5-8354840ad4df+5:2362:x1874531108109952:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 1630us (2948us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692531.893933:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00010000:00010000:1.0:1787692531.893973:0:14357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.893983:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.894428:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7a7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.894440:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.894447:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692531.899316:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787692531.899336:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.899347:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.899356:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.899501:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692531.899507:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.899515:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.899531:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec94636000) 00010000:00010000:1.0:1787692531.899534:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787692531.899538:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.899544:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7a0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787692531.899564:0:14357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3a53c94 reply state 000000001ad08edb transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692531.899572:0:14357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787692531.899916:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+10:14444:x1874531108109824:12345-192.168.206.27@tcp:36:lfs.0 Request processed in 13530us (13947us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787692531.899925:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 19 00010000:00010000:0.0:1787692531.905196:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7a7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.905213:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7a7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.905222:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7a7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.905229:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692531.905234:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7a7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.905242:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7a7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.905270:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92ec9dbfad00) 00010000:00010000:0.0:1787692531.905273:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692531.905277:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7a7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692531.905283:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7a7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787692531.905841:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787692531.984956:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692531.987951:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108110080 00000100:00100000:1.0:1787692531.987966:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108110080 00000100:00100000:1.0:1787692531.988042:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:1.0:1787692531.988052:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+9:14452:x1874531108110080:12345-192.168.206.27@tcp:101:lctl.0 00010000:00010000:1.0:1787692531.988072:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692531.988094:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b26f0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.988164:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df7b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.988176:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.988188:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692531.988240:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787692531.988678:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692531.988737:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df7b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.988762:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26f0 expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.988781:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164e00/0x5d8b8560a09df7b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26f0 expref: 10 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692531.988790:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9dbfae00) 00010000:00010000:1.0:1787692531.988793:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787692531.988805:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164e00, rc 0) 00000100:00100000:1.0:1787692531.988929:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+10:14452:x1874531108110080:12345-192.168.206.27@tcp:101:lctl.0 Request processed in 877us (3981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692531.988938:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 20 00000100:00100000:3.0:1787692532.016160:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692532.016927:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108110208 00000100:00100000:1.0:1787692532.016939:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108110208 00000100:00100000:1.0:1787692532.017073:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:1.0:1787692532.017084:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:425c109c-a84e-4018-a3a5-8354840ad4df+5:14453:x1874531108110208:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:1.0:1787692532.017105:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787692532.017126:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b26f7 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692532.017190:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692532.017204:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692532.017215:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787692532.017280:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787692532.017285:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787692532.017309:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692532.017334:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164400/0x5d8b8560a09df7bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26f7 expref: 7 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692532.017367:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88164a00/0x5d8b8560a09df7c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26f7 expref: 6 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692532.017522:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9dbfae00) 00010000:00010000:1.0:1787692532.017525:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787692532.017528:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88164a00, rc 0) 00000100:00100000:1.0:1787692532.017599:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:425c109c-a84e-4018-a3a5-8354840ad4df+6:14453:x1874531108110208:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 516us (1448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692532.017616:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 21 00000100:00100000:3.0:1787692532.020935:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.021047:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108110336 00000100:00100000:2.0:1787692532.021057:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108110336 00000100:00100000:2.0:1787692532.021116:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:2.0:1787692532.021128:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:425c109c-a84e-4018-a3a5-8354840ad4df+6:14453:x1874531108110336:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692532.021149:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692532.021172:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df7ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b26fe expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021235:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df7d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021248:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021259:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021273:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df7d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021306:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021314:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021425:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df7df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021434:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df7df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021441:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df7df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692532.021476:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787692532.021480:0:14356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692532.021504:0:14356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df7df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021516:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df7d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021521:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df7d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021527:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021533:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692532.021538:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df7d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021551:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df7d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021563:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9dbfae00) 00010000:00010000:2.0:1787692532.021566:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692532.021570:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df7d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021576:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df7d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021588:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021594:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df7d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021600:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021605:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692532.021607:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021613:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df7d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021620:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92ec94636600) 00010000:00010000:2.0:1787692532.021622:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692532.021625:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df7d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021641:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df7d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021674:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df7ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26fe expref: 8 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021688:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df7df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26fe expref: 7 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.021695:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ec94636100) 00010000:00010000:2.0:1787692532.021698:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787692532.021700:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3600, rc 0) 00000100:00100000:2.0:1787692532.021766:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:425c109c-a84e-4018-a3a5-8354840ad4df+7:14453:x1874531108110336:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 641us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692532.021773:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 22 00000100:00100000:2.0:1787692532.045610:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692532.045745:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108110592 00000100:00100000:1.0:1787692532.045754:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108110592 00000100:00100000:0.0:1787692532.046522:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:0.0:1787692532.046536:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:425c109c-a84e-4018-a3a5-8354840ad4df+7:14453:x1874531108110592:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692532.046555:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692532.046576:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1e00/0x5d8b8560a09df7e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2705 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692532.046693:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787692532.046840:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1e00/0x5d8b8560a09df7e6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2705 expref: 9 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.046855:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9dbfae00) 00010000:00010000:0.0:1787692532.046858:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787692532.046863:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1e00/0x5d8b8560a09df7e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2705 expref: 9 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.046876:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1e00, rc 0) 00000100:00100000:0.0:1787692532.047036:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:425c109c-a84e-4018-a3a5-8354840ad4df+8:14453:x1874531108110592:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 503us (1434us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787692532.047044:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 23 00000100:00100000:1.0:1787692532.051946:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.052027:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108110848 00000100:00100000:0.0:1787692532.052038:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108110848 00000100:00100000:0.0:1787692532.052100:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:0.0:1787692532.052110:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:425c109c-a84e-4018-a3a5-8354840ad4df+8:14453:x1874531108110848:12345-192.168.206.27@tcp:36:lfs.0 00010000:00010000:0.0:1787692532.052161:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692532.052187:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df7df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b26fe expref: 8 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.052206:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ec94636100) 00010000:00010000:0.0:1787692532.052217:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787692532.052239:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df7f4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.052251:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df7f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.052260:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df7f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787692532.052457:0:14358:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042feca92 reply state 000000003add51be transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df7f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692532.052466:0:14358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787692532.052479:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1787692532.052568:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:425c109c-a84e-4018-a3a5-8354840ad4df+9:14453:x1874531108110848:12345-192.168.206.27@tcp:36:lfs.0 Request processed in 459us (631us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787692532.052575:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 24 00000100:00100000:1.0:1787692532.058919:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00010000:00010000:2.0:1787692532.059021:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df7f4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692532.059026:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108111104 00010000:00010000:2.0:1787692532.059037:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df7f4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692532.059038:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108111104 00010000:00010000:2.0:1787692532.059049:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df7f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.059056:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0c00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692532.059063:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df7f4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.059084:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df7f4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692532.059098:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00010000:00010000:2.0:1787692532.059102:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ec832f4f00) 00010000:00010000:2.0:1787692532.059108:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1787692532.059114:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df7f4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692532.059121:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:425c109c-a84e-4018-a3a5-8354840ad4df+9:14453:x1874531108111104:12345-192.168.206.27@tcp:35:lfs.0 00010000:00010000:2.0:1787692532.059124:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e0c00/0x5d8b8560a09df7f4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692532.059376:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:425c109c-a84e-4018-a3a5-8354840ad4df+9:14453:x1874531108111104:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 259us (467us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787692532.059384:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:2.0:1787692532.064558:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.065073:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108111360 00000100:00100000:0.0:1787692532.065084:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108111360 00000100:00100000:0.0:1787692532.065181:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:0.0:1787692532.065193:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:425c109c-a84e-4018-a3a5-8354840ad4df+9:14453:x1874531108111360:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692532.065215:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692532.065236:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1e00/0x5d8b8560a09df7fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b270c expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065309:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df802 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065323:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df802 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065335:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df802 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065350:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df809 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065358:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065365:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692532.065506:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787692532.065603:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df802 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065611:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df802 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065618:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df802 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065624:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692532.065628:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df802 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065651:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df802 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065665:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9dbfae00) 00010000:00010000:0.0:1787692532.065668:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692532.065673:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df802 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065679:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df802 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065693:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df809 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065699:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df809 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065716:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df809 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065721:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692532.065724:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df809 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065730:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df809 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065738:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92ec832f4400) 00010000:00010000:0.0:1787692532.065741:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692532.065744:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df809 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065750:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df809 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065786:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1e00/0x5d8b8560a09df7fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b270c expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065806:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9dbfae00) 00010000:00010000:0.0:1787692532.065809:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787692532.065870:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1e00/0x5d8b8560a09df7fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b270c expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.065880:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1e00, rc 0) 00000100:00100000:0.0:1787692532.065939:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:425c109c-a84e-4018-a3a5-8354840ad4df+10:14453:x1874531108111360:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 749us (1402us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1787692532.065956:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 25 00000100:00100000:1.0:1787692532.075922:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.076312:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108111488 00000100:00100000:0.0:1787692532.076322:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108111488 00000100:00100000:0.0:1787692532.076380:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:0.0:1787692532.076390:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:425c109c-a84e-4018-a3a5-8354840ad4df+10:14453:x1874531108111488:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692532.076410:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692532.076429:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df817 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2713 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.076511:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df81e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.076524:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df81e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.076535:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df81e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692532.076582:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787692532.076585:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692532.076605:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df81e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.076628:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df817 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2713 expref: 12 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.076657:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df81e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2713 expref: 11 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.076683:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ec832f4400) 00010000:00010000:0.0:1787692532.076686:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787692532.076689:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35b600, rc 0) 00000100:00100000:0.0:1787692532.076757:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:425c109c-a84e-4018-a3a5-8354840ad4df+11:14453:x1874531108111488:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 367us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692532.076765:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 26 00000100:00100000:1.0:1787692532.079616:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.079809:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108111616 00000100:00100000:0.0:1787692532.079861:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108111616 00000100:00100000:0.0:1787692532.079904:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:0.0:1787692532.079914:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:425c109c-a84e-4018-a3a5-8354840ad4df+11:14453:x1874531108111616:12345-192.168.206.27@tcp:37:lfs.0 00000100:00100000:0.0:1787692532.083349:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:425c109c-a84e-4018-a3a5-8354840ad4df+11:14453:x1874531108111616:12345-192.168.206.27@tcp:37:lfs.0 Request processed in 3424us (3731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692532.083364:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:3.0:1787692532.091141:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692532.091219:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108111872 00000100:00100000:1.0:1787692532.091229:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108111872 00000100:00100000:1.0:1787692532.091276:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:1.0:1787692532.091285:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbbd2e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:425c109c-a84e-4018-a3a5-8354840ad4df+11:14453:x1874531108111872:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:1.0:1787692532.091516:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbbd2e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:425c109c-a84e-4018-a3a5-8354840ad4df+12:14453:x1874531108111872:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 231us (383us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787692532.091524:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:1.0:1787692532.143364:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.143467:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108112000 00000100:00100000:0.0:1787692532.143479:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108112000 00000100:00100000:0.0:1787692532.143552:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:0.0:1787692532.143564:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+10:14459:x1874531108112000:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:0.0:1787692532.143584:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692532.143607:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df825 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b271a expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.143673:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a400/0x5d8b8560a09df82c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.143689:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a400/0x5d8b8560a09df82c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.143714:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a400/0x5d8b8560a09df82c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.143731:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df833 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.143738:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df833 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.143745:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df833 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.143906:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a000/0x5d8b8560a09df83a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.143914:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a000/0x5d8b8560a09df83a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.143920:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a000/0x5d8b8560a09df83a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692532.143953:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787692532.143956:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787692532.143997:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a000/0x5d8b8560a09df83a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144010:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a400/0x5d8b8560a09df82c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144016:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a400/0x5d8b8560a09df82c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144032:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a400/0x5d8b8560a09df82c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144038:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692532.144042:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a400/0x5d8b8560a09df82c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144049:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a400/0x5d8b8560a09df82c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144061:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9dbfae00) 00010000:00010000:0.0:1787692532.144065:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692532.144069:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a400/0x5d8b8560a09df82c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144075:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a400/0x5d8b8560a09df82c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144088:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df833 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144095:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df833 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144102:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df833 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144107:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692532.144110:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df833 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144126:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df833 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144135:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff92ec832f4c00) 00010000:00010000:0.0:1787692532.144137:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692532.144140:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df833 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144146:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a800/0x5d8b8560a09df833 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144177:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df825 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b271a expref: 12 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144189:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a000/0x5d8b8560a09df83a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b271a expref: 11 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.144196:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ec832f4400) 00010000:00010000:0.0:1787692532.144198:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787692532.144201:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35a000, rc 0) 00000100:00100000:0.0:1787692532.144268:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+11:14459:x1874531108112000:12345-192.168.206.27@tcp:101:bash.0 Request processed in 706us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692532.144275:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 27 00000100:00100000:3.0:1787692532.152484:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.152612:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108112256 00000100:00100000:2.0:1787692532.152626:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108112256 00000100:00100000:2.0:1787692532.152710:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 28 00000100:00100000:2.0:1787692532.152725:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+11:14459:x1874531108112256:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1787692532.152756:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692532.153189:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df841 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2721 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.154556:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.154588:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df81e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2713 expref: 11 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.154599:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.154678:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df81e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2713 expref: 11 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.154700:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df81e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2713 expref: 11 pid: 14358 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692532.154717:0:14356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14356:1874531125925120:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692532.155282:0:14356:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb22aa180 going to sleep for 11 seconds 00000100:00100000:2.0:1787692532.159726:0:14356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14356:1874531125925120:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692532.159769:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692532.160001:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.160090:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108112384 00000100:00100000:0.0:1787692532.160101:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108112384 00010000:00010000:0.0:1787692532.160156:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df81e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2713 expref: 12 pid: 14358 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692532.160233:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:0.0:1787692532.160245:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425c109c-a84e-4018-a3a5-8354840ad4df+12:2362:x1874531108112384:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692532.160267:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692532.160277:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df81e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2713 expref: 12 pid: 14358 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.160291:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df81e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2713 expref: 12 pid: 14358 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.160319:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df81e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2713 expref: 12 pid: 14358 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.160337:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ec832f4400) 00010000:00010000:0.0:1787692532.160343:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.160354:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.160361:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.160394:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692532.160536:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:425c109c-a84e-4018-a3a5-8354840ad4df+11:2362:x1874531108112384:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 291us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692532.160545:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00010000:00010000:2.0:1787692532.160668:0:14356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.160676:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.160704:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df84f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.160716:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df84f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.160724:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df84f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.161748:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df856 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.161780:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df856 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.161805:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df856 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692532.161859:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787692532.161898:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.161905:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.161911:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.161917:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a2600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692532.161922:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.161929:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.161941:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ec832f4400) 00010000:00010000:2.0:1787692532.161944:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692532.161948:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.161954:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df848 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787692532.161967:0:14356:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000064f8982a reply state 00000000e45b7c48 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df84f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692532.161982:0:14356:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787692532.162026:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df841 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2721 expref: 14 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.162041:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df856 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2721 expref: 13 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.162071:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:2.0:1787692532.162074:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1787692532.162076:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3a00, rc 0) 00000100:00100000:2.0:1787692532.162145:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+14:14459:x1874531108112256:12345-192.168.206.27@tcp:101:bash.0 Request processed in 9423us (9678us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787692532.162155:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 28 00010000:00010000:0.0:1787692532.169335:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df84f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.169376:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df84f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.169385:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df84f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.169392:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692532.169399:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df84f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.169408:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df84f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.169428:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff92ec94636600) 00010000:00010000:0.0:1787692532.169432:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692532.169437:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df84f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.169444:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df84f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692532.178390:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.185100:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108112512 00000100:00100000:2.0:1787692532.185123:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108112512 00000100:00100000:2.0:1787692532.185223:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:2.0:1787692532.185238:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+13:14459:x1874531108112512:12345-192.168.206.27@tcp:101:bash.0 00010000:00010000:2.0:1787692532.185272:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692532.185300:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df864 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2728 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.185390:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df86b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.185407:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df86b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.185442:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df86b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692532.185495:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787692532.185500:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692532.185524:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df86b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.185537:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df86b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.185567:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df864 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2728 expref: 15 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.185592:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df86b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2728 expref: 14 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.185603:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:2.0:1787692532.185606:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692532.185611:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2600, rc 0) 00000100:00100000:2.0:1787692532.185709:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+14:14459:x1874531108112512:12345-192.168.206.27@tcp:101:bash.0 Request processed in 474us (7378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692532.185716:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 29 00000100:00100000:1.0:1787692532.190089:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.191159:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108112768 00000100:00100000:2.0:1787692532.191179:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108112768 00000100:00100000:2.0:1787692532.191261:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:2.0:1787692532.191277:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+14:14459:x1874531108112768:12345-192.168.206.27@tcp:35:bash.0 00000100:00100000:2.0:1787692532.191744:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+15:14459:x1874531108112768:12345-192.168.206.27@tcp:35:bash.0 Request processed in 470us (1663us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787692532.191770:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:3.0:1787692532.276026:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.276129:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108113024 00000100:00100000:2.0:1787692532.276139:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108113024 00000100:00100000:2.0:1787692532.276196:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 30 00000100:00100000:2.0:1787692532.276206:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+15:14469:x1874531108113024:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:2.0:1787692532.276227:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692532.276245:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df872 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b272f expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692532.276361:0:14356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787692532.276479:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df872 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b272f expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.276492:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92ec9dbfae00) 00010000:00010000:2.0:1787692532.276495:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787692532.276500:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df872 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b272f expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.276514:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3800, rc 0) 00000100:00100000:2.0:1787692532.276677:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+16:14469:x1874531108113024:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 471us (658us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787692532.276684:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 30 00000100:00100000:3.0:1787692532.283923:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692532.284105:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108113280 00000100:00100000:1.0:1787692532.284115:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108113280 00000100:00100000:1.0:1787692532.284222:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:1.0:1787692532.284233:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+16:14469:x1874531108113280:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:1.0:1787692532.284510:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+17:14469:x1874531108113280:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 278us (594us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787692532.284518:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:1.0:1787692532.308490:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.308596:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108113536 00000100:00100000:0.0:1787692532.308611:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108113536 00000100:00100000:0.0:1787692532.308697:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:0.0:1787692532.308711:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+17:14472:x1874531108113536:12345-192.168.206.27@tcp:101:lfs.0 00010000:00010000:0.0:1787692532.308742:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692532.308769:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df880 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2736 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.308948:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df887 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.308963:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df887 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.308975:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df887 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692532.308987:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787692532.309115:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df880 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2736 expref: 20 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.309132:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df887 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2736 expref: 19 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.309141:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:0.0:1787692532.309143:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692532.309147:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35a200, rc 0) 00000100:00100000:0.0:1787692532.309225:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+19:14472:x1874531108113536:12345-192.168.206.27@tcp:101:lfs.0 Request processed in 517us (749us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787692532.309236:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 31 00000100:00100000:3.0:1787692532.313234:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692532.313280:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.313496:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108113664 00000100:00100000:2.0:1787692532.313507:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108113664 00000100:00100000:2.0:1787692532.313560:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00100000:2.0:1787692532.313570:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+19:14472:x1874531108113664:12345-192.168.206.27@tcp:54:lfs.0 00010000:00010000:2.0:1787692532.313673:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df895 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.313690:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df895 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.313702:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df895 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.313730:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df895 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.313737:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df895 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.313756:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df895 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.313762:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692532.313766:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df895 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.313774:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df895 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.313785:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:2.0:1787692532.313788:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787692532.313803:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df895 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.313809:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df895 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692532.313926:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+19:14472:x1874531108113664:12345-192.168.206.27@tcp:54:lfs.0 Request processed in 357us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692532.313935:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 32 00000100:00100000:0.0:1787692532.314663:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108113792 00000100:00100000:0.0:1787692532.314672:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108113792 00000100:00100000:0.0:1787692532.314829:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:0.0:1787692532.314840:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+19:2364:x1874531108113792:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692532.314851:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692532.314897:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df887 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2736 expref: 19 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.314914:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:0.0:1787692532.314918:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692532.314973:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+18:2364:x1874531108113792:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 135us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692532.314981:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:3.0:1787692532.318288:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.322752:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108114048 00000100:00100000:2.0:1787692532.322777:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108114048 00000100:00100000:2.0:1787692532.322856:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:2.0:1787692532.322868:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+18:14472:x1874531108114048:12345-192.168.206.27@tcp:35:lfs.0 00000100:00100000:2.0:1787692532.323120:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+19:14472:x1874531108114048:12345-192.168.206.27@tcp:35:lfs.0 Request processed in 254us (4842us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787692532.323140:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:1.0:1787692532.385553:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692532.385669:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692532.385720:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692532.385750:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.385809:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108114432 00000100:00100000:1.0:1787692532.385843:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.385850:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108114432 00000100:00100000:1.0:1787692532.385872:0:15856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108114688 00000100:00100000:1.0:1787692532.385878:0:15856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108114688 00000100:00100000:3.0:1787692532.385953:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108114304 00000100:00100000:3.0:1787692532.385958:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108114304 00000100:00100000:1.0:1787692532.386015:0:15856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108114560 00000100:00100000:1.0:1787692532.386019:0:15856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108114560 00000100:00100000:0.0:1787692532.386266:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:0.0:1787692532.386278:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:425c109c-a84e-4018-a3a5-8354840ad4df+5:2363:x1874531108114688:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692532.386360:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:425c109c-a84e-4018-a3a5-8354840ad4df+5:2363:x1874531108114688:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 84us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692532.386367:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:0.0:1787692532.386385:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:0.0:1787692532.386391:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+5:2363:x1874531108114432:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:0.0:1787692532.386414:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+5:2363:x1874531108114432:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 24us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692532.386432:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00080000:0.0:1787692532.386462:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787692532.386466:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787692532.389599:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108114176 00000100:00100000:2.0:1787692532.389615:0:14349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108114176 00000100:00100000:2.0:1787692532.389698:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 119 00000100:00100000:2.0:1787692532.389711:0:14349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+13:2363:x1874531108114176:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:2.0:1787692532.389909:0:14349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4b7addca-b783-44df-be6e-98e7ff20be97+13:2363:x1874531108114176:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 200us (4364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692532.389918:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 119 00000100:00100000:3.0:1787692532.391730:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:3.0:1787692532.391749:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+5:2363:x1874531108114304:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:3.0:1787692532.391857:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+5:2363:x1874531108114304:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 116us (6106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692532.391865:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:1.0:1787692532.392938:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:1.0:1787692532.392954:0:15856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:425c109c-a84e-4018-a3a5-8354840ad4df+5:2363:x1874531108114560:12345-192.168.206.27@tcp:400:kworker.0 00000100:00100000:1.0:1787692532.393029:0:15856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:425c109c-a84e-4018-a3a5-8354840ad4df+5:2363:x1874531108114560:12345-192.168.206.27@tcp:400:kworker.0 Request processed in 82us (7217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692532.393037:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00010000:00010000:2.0:1787692532.482159:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787692532.635787:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.636264:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108114944 00000100:00100000:0.0:1787692532.636275:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108114944 00000100:00100000:0.0:1787692532.636336:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:0.0:1787692532.636351:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+19:14503:x1874531108114944:12345-192.168.206.27@tcp:101:cat.0 00010000:00010000:0.0:1787692532.636398:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787692532.636420:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df89c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b273d expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.636510:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df8a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.636524:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.636534:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787692532.636544:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787692532.636683:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a200/0x5d8b8560a09df89c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b273d expref: 22 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.636702:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b273d expref: 21 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.636711:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:0.0:1787692532.636715:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787692532.636718:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec8b35b600, rc 0) 00000100:00100000:0.0:1787692532.636785:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+21:14503:x1874531108114944:12345-192.168.206.27@tcp:101:cat.0 Request processed in 440us (1007us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1787692532.636803:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 33 00000100:00100000:3.0:1787692532.641082:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692532.641136:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.641227:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108115328 00000100:00100000:0.0:1787692532.641237:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108115328 00000100:00100000:0.0:1787692532.641306:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:0.0:1787692532.641328:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+21:2364:x1874531108115328:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692532.641345:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692532.641380:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b600/0x5d8b8560a09df8a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b273d expref: 21 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.641400:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:0.0:1787692532.641406:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692532.641455:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+20:2364:x1874531108115328:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 128us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692532.641463:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:2.0:1787692532.642034:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108115200 00000100:00100000:2.0:1787692532.642041:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108115200 00000100:00100000:2.0:1787692532.642088:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:2.0:1787692532.642097:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+20:14503:x1874531108115200:12345-192.168.206.27@tcp:35:cat.0 00000100:00100000:2.0:1787692532.646438:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+21:14503:x1874531108115200:12345-192.168.206.27@tcp:35:cat.0 Request processed in 4330us (5353us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787692532.646465:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 8 00000100:00100000:3.0:1787692532.732440:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.732686:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108115584 00000100:00100000:2.0:1787692532.732697:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108115584 00000100:00100000:2.0:1787692532.732775:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:2.0:1787692532.732787:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+21:14509:x1874531108115584:12345-192.168.206.27@tcp:101:dd.0 00010000:00010000:2.0:1787692532.732859:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692532.732881:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df8b1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2744 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.732973:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2e00/0x5d8b8560a09df8b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.732989:0:14357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df856 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2721 expref: 22 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.732997:0:14357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df86b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2728 expref: 22 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.733005:0:14357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2e00/0x5d8b8560a09df8b8 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.733038:0:14357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df86b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2728 expref: 22 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.733051:0:14357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df86b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2728 expref: 22 pid: 14358 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692532.733065:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1874531125925248:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692532.733189:0:14357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df856 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2721 expref: 22 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.733198:0:14357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df856 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2721 expref: 22 pid: 14356 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692532.733207:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1874531125925376:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692532.733229:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb22aa900 going to sleep for 11 seconds 00000100:00100000:3.0:1787692532.739609:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.739682:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108115712 00000100:00100000:0.0:1787692532.739692:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108115712 00010000:00010000:0.0:1787692532.739734:0:14343:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df856 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2721 expref: 23 pid: 14356 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692532.739782:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:0.0:1787692532.739805:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb8520ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+23:2361:x1874531108115712:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692532.739858:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692532.739866:0:14343:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df856 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2721 expref: 23 pid: 14356 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.739878:0:14343:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df856 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2721 expref: 23 pid: 14356 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.739901:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:0.0:1787692532.739906:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2e00/0x5d8b8560a09df8b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.739928:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2e00/0x5d8b8560a09df8b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.739934:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692532.740009:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb8520ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+23:2361:x1874531108115712:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 209us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692532.740017:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:0.0:1787692532.740980:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.741635:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1874531125925248:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692532.741654:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df856 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2721 expref: 22 pid: 14356 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692532.741672:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1874531125925376:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692532.741698:0:14357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2e00/0x5d8b8560a09df8b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692532.741995:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108115840 00000100:00100000:3.0:1787692532.742003:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108115840 00010000:00010000:3.0:1787692532.742033:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df86b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2728 expref: 22 pid: 14358 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692532.742068:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 12 00000100:00100000:3.0:1787692532.742077:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+22:2362:x1874531108115840:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692532.742101:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692532.742109:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df86b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2728 expref: 22 pid: 14358 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692532.742121:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df86b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2728 expref: 22 pid: 14358 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692532.742142:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2600/0x5d8b8560a09df86b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2728 expref: 22 pid: 14358 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692532.742154:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:3.0:1787692532.742158:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2e00/0x5d8b8560a09df8b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692532.742167:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2e00/0x5d8b8560a09df8b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692532.742174:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2e00/0x5d8b8560a09df8b8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692532.742200:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692532.742251:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+21:2362:x1874531108115840:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 175us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692532.742259:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 12 00010000:00010000:2.0:1787692532.742309:0:14357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2e00/0x5d8b8560a09df8b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.742317:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2e00/0x5d8b8560a09df8b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692532.742336:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787692532.742507:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df8b1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2744 expref: 22 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.742521:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2e00/0x5d8b8560a09df8b8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2744 expref: 21 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.742536:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:2.0:1787692532.742539:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787692532.742551:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2e00, rc 0) 00000100:00100000:2.0:1787692532.742577:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+21:14509:x1874531108115584:12345-192.168.206.27@tcp:101:dd.0 Request processed in 9794us (10149us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787692532.742584:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 34 00000100:00100000:0.0:1787692532.749198:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.749390:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108116096 00000100:00100000:2.0:1787692532.749400:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108116096 00000100:00100000:2.0:1787692532.749463:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 35 00000100:00100000:2.0:1787692532.749472:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+21:14509:x1874531108116096:12345-192.168.206.27@tcp:36:dd.0 00010000:00010000:2.0:1787692532.749731:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8c6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.749747:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.749757:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787692532.749866:0:14358:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787692532.749901:0:14358:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b53ca7d reply state 00000000ab219cdf transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692532.749911:0:14358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787692532.750013:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+24:14509:x1874531108116096:12345-192.168.206.27@tcp:36:dd.0 Request processed in 541us (824us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787692532.750020:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 35 00000020:00080000:2.0:1787692532.750037:0:14358:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787692532.753996:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692532.754120:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108116224 00000100:00100000:3.0:1787692532.754130:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108116224 00000100:00100000:3.0:1787692532.754187:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 36 00000100:00100000:3.0:1787692532.754197:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+24:14509:x1874531108116224:12345-192.168.206.27@tcp:101:dd.0 00010000:00010000:3.0:1787692532.754238:0:14357:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787692532.754260:0:14357:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b15a00/0x5d8b8560a09df8cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b274b expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692532.754323:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b15a00/0x5d8b8560a09df8cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b274b expref: 25 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692532.754338:0:14357:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b15a00/0x5d8b8560a09df8cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b274b expref: 25 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692532.754355:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:3.0:1787692532.754358:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787692532.754362:0:14357:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec88b15a00, rc 0) 00000100:00100000:3.0:1787692532.754434:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+25:14509:x1874531108116224:12345-192.168.206.27@tcp:101:dd.0 Request processed in 238us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692532.754442:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 36 00010000:00010000:2.0:1787692532.757054:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.757072:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8c6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.757080:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.757086:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692532.757091:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.757099:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8c6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.757116:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:2.0:1787692532.757119:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692532.757123:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8c6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.757129:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8c6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692532.785112:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692532.785253:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108116480 00000100:00100000:1.0:1787692532.785262:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108116480 00000100:00100000:1.0:1787692532.785355:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:1.0:1787692532.785375:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf71e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+24:14509:x1874531108116480:12345-192.168.206.27@tcp:103:dd.0 00010000:00010000:1.0:1787692532.785394:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787692532.785418:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b15a00/0x5d8b8560a09df8cd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b274b expref: 24 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692532.785435:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:1.0:1787692532.785440:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787692532.785496:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf71e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+23:14509:x1874531108116480:12345-192.168.206.27@tcp:103:dd.0 Request processed in 122us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692532.785503:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:3.0:1787692532.788339:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.788568:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108116608 00000100:00100000:2.0:1787692532.788577:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108116608 00000100:00100000:2.0:1787692532.788638:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:2.0:1787692532.788648:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+23:14509:x1874531108116608:12345-192.168.206.27@tcp:58:dd.0 00010000:00010000:2.0:1787692532.788736:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8d4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.788779:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.788799:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787692532.789597:0:14356:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787692532.789745:0:14356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787692532.790369:0:14356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787692532.790505:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+23:14509:x1874531108116608:12345-192.168.206.27@tcp:58:dd.0 Request processed in 1853us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692532.790515:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 37 00000100:00100000:3.0:1787692532.793206:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.793307:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108116736 00000100:00100000:2.0:1787692532.793317:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108116736 00000100:00100000:2.0:1787692532.793378:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 38 00000100:00100000:2.0:1787692532.793388:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+23:14509:x1874531108116736:12345-192.168.206.27@tcp:101:dd.0 00010000:00010000:2.0:1787692532.793405:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692532.793436:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df8db lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2752 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.793490:0:14358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8d4 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.793502:0:14358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df8db lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2752 expref: 24 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.793519:0:14358:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.793552:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df8db lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2752 expref: 24 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.793565:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:2.0:1787692532.793569:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787692532.793573:0:14358:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df8db lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2752 expref: 24 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.793580:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2800, rc 0) 00000100:00100000:2.0:1787692532.793680:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+24:14509:x1874531108116736:12345-192.168.206.27@tcp:101:dd.0 Request processed in 293us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692532.793687:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 38 00000040:00080000:1.0:1787692532.930290:0:14390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787692532.930299:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787692532.930363:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787692532.930371:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787692532.933283:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2df800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14390:1874531125925504:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787692532.933626:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec9050d180 going to sleep for 11 seconds 00000100:00100000:3.0:1787692532.937968:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692532.938149:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2df800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14390:1874531125925504:192.168.206.27@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787692532.939968:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108116864 00000100:00100000:2.0:1787692532.939981:0:14367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108116864 00000100:00100000:2.0:1787692532.940149:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:2.0:1787692532.940161:0:14367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+24:14510:x1874531108116864:12345-192.168.206.27@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787692532.940255:0:14367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+24:14510:x1874531108116864:12345-192.168.206.27@tcp:900:lhsmtool_posix.0 Request processed in 97us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692532.940264:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:3.0:1787692532.942528:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.942641:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108116992 00000100:00100000:0.0:1787692532.942650:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108116992 00000100:00100000:0.0:1787692532.942706:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:0.0:1787692532.942716:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+24:14510:x1874531108116992:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787692532.942747:0:14356:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787692532.942921:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+24:14510:x1874531108116992:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 205us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692532.942928:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 39 00000100:00100000:3.0:1787692532.954574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.954992:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108117120 00000100:00100000:2.0:1787692532.955003:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108117120 00000100:00100000:2.0:1787692532.955062:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:2.0:1787692532.955073:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+24:14510:x1874531108117120:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787692532.955145:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df8e2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955180:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955195:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955244:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8e9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955252:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955259:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955285:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955294:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955301:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692532.955341:0:14357:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787692532.955345:0:14357:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692532.955361:0:14357:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955372:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df8e2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955389:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df8e2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955409:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df8e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955414:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692532.955419:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df8e2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955427:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df8e2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955439:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:2.0:1787692532.955443:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692532.955447:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df8e2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955454:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df8e2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955468:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955474:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8e9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955480:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955485:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692532.955494:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955500:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8e9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955508:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff92ec94636c00) 00010000:00010000:2.0:1787692532.955510:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692532.955513:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8e9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955519:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8e9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955534:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955550:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955556:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955560:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692532.955563:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955569:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955576:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:2.0:1787692532.955578:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692532.955587:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.955593:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692532.955976:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+24:14510:x1874531108117120:12345-192.168.206.27@tcp:34:lhsmtool_posix.0 Request processed in 900us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692532.955984:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 40 00000100:00100000:3.0:1787692532.967121:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.967234:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108117376 00000100:00100000:2.0:1787692532.967243:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108117376 00000100:00100000:2.0:1787692532.967301:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:2.0:1787692532.967311:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+24:14510:x1874531108117376:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692532.967333:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692532.967354:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2759 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.967631:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8fe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.967646:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.967656:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692532.967667:0:14358:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787692532.967756:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8fe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.967933:0:14358:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8fe lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.967953:0:14358:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.967959:0:14358:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692532.967963:0:14358:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8fe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.967971:0:14358:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8fe lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.967982:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:2.0:1787692532.967985:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787692532.967989:0:14358:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8fe lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.967994:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df8fe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.968037:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2759 expref: 26 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.968047:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff92ec9dbfa900) 00010000:00010000:2.0:1787692532.968049:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787692532.968053:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df8f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2759 expref: 26 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.968062:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3600, rc 0) 00000100:00100000:2.0:1787692532.968180:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+25:14510:x1874531108117376:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 870us (1068us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787692532.968196:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 41 00000100:00100000:3.0:1787692532.972883:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.972976:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108117504 00000100:00100000:2.0:1787692532.972986:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108117504 00000100:00100000:2.0:1787692532.973037:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:2.0:1787692532.973048:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+25:14510:x1874531108117504:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787692532.973113:0:14357:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787692532.973233:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+25:14510:x1874531108117504:12345-192.168.206.27@tcp:53:lhsmtool_posix.0 Request processed in 186us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692532.973241:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 42 00000100:00100000:3.0:1787692532.977241:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.977570:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108117760 00000100:00100000:2.0:1787692532.977581:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108117760 00000100:00100000:2.0:1787692532.977683:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:2.0:1787692532.977694:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+25:14510:x1874531108117760:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692532.977713:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692532.977734:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df90c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2760 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787692532.978555:0:14358:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1787692532.978564:0:14358:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1787692532.978614:0:14358:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1787692532.979010:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df913 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.979026:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df913 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.979037:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df913 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.979108:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df90c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2760 expref: 28 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.979127:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df913 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2760 expref: 27 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.979135:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ec94636c00) 00010000:00010000:2.0:1787692532.979138:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787692532.979141:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3200, rc 0) 00000100:00100000:2.0:1787692532.979219:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+27:14510:x1874531108117760:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 1527us (1988us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1787692532.979228:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 43 00000100:00100000:3.0:1787692532.982365:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692532.982524:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108118016 00000100:00100000:0.0:1787692532.982533:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108118016 00000100:00100000:0.0:1787692532.982588:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:0.0:1787692532.982599:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+27:14510:x1874531108118016:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787692532.982652:0:14356:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692532.982677:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df913 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2760 expref: 27 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982713:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ec94636c00) 00010000:00010000:0.0:1787692532.982724:0:14356:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787692532.982745:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df921 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982757:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df921 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982775:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df921 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982799:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df928 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2a6fb10c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982807:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df928 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a6fb10c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982857:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df928 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a6fb10c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982925:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df921 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982932:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df921 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982939:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df921 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982945:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35b200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692532.982949:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df921 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982962:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df921 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982972:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff92ec832f4400) 00010000:00010000:0.0:1787692532.982975:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692532.982978:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df921 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982985:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35b200/0x5d8b8560a09df921 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.982995:0:14356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df928 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a6fb10c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.983001:0:14356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df928 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a6fb10c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.983007:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df928 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a6fb10c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.983012:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:0.0:1787692532.983014:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df928 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a6fb10c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.983019:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df928 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a6fb10c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.983025:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x2a6fb10c (ffff92ec832f4c00) 00010000:00010000:0.0:1787692532.983028:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787692532.983030:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df928 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2a6fb10c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692532.983045:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df928 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2a6fb10c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692532.983119:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+26:14510:x1874531108118016:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 521us (763us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787692532.983126:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 44 00000100:00100000:3.0:1787692532.985771:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.986015:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108118144 00000100:00100000:2.0:1787692532.986024:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108118144 00000100:00100000:2.0:1787692532.986112:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:2.0:1787692532.986123:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+26:14510:x1874531108118144:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692532.986144:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692532.986170:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df92f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2767 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.986219:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df936 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.986231:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df936 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.986242:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df936 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.986347:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df92f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2767 expref: 28 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.986377:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3800/0x5d8b8560a09df936 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2767 expref: 27 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.986386:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ec94636500) 00010000:00010000:2.0:1787692532.986389:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787692532.986553:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3800, rc 0) 00000100:00100000:2.0:1787692532.986620:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+27:14510:x1874531108118144:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 498us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692532.986627:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 45 00000100:00100000:1.0:1787692532.989011:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692532.989137:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108118400 00000100:00100000:3.0:1787692532.989154:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108118400 00000100:00100000:3.0:1787692532.989209:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:3.0:1787692532.989221:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+27:14510:x1874531108118400:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787692532.989296:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14200/0x5d8b8560a09df93d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692532.989313:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14200/0x5d8b8560a09df93d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692532.989324:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14200/0x5d8b8560a09df93d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787692532.989719:0:14357:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1787692532.989733:0:14357:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 439195919177ns, next at 440195916351ns, rc = 0 00000004:00010000:3.0:1787692532.990647:0:14357:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8356fed reply state 00000000cf0efef8 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14200/0x5d8b8560a09df93d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692532.990660:0:14357:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787692532.990976:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+29:14510:x1874531108118400:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 1753us (1971us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787692532.990985:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 46 00000100:00100000:0.0:1787692532.993546:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692532.993956:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108118528 00000100:00100000:2.0:1787692532.993967:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108118528 00000100:00100000:2.0:1787692532.994023:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 47 00000100:00100000:2.0:1787692532.994034:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec878b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+29:14510:x1874531108118528:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692532.994061:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692532.994083:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df944 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b276e expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.994148:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df944 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b276e expref: 30 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.994164:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df944 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b276e expref: 30 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692532.994210:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ec94636500) 00010000:00010000:2.0:1787692532.994213:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787692532.994217:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2a00, rc 0) 00000100:00100000:2.0:1787692532.994276:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec878b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+30:14510:x1874531108118528:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 244us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692532.994283:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 47 00010000:00010000:1.0:1787692532.994433:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14200/0x5d8b8560a09df93d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692532.994442:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14200/0x5d8b8560a09df93d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692532.994448:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14200/0x5d8b8560a09df93d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692532.994453:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b14200 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692532.994458:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14200/0x5d8b8560a09df93d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692532.994465:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14200/0x5d8b8560a09df93d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692532.994476:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ec94636500) 00010000:00010000:1.0:1787692532.994479:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787692532.994483:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14200/0x5d8b8560a09df93d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692532.994489:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14200/0x5d8b8560a09df93d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692532.997475:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692532.997648:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108118656 00000100:00100000:3.0:1787692532.997658:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108118656 00000100:00100000:3.0:1787692532.997752:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:3.0:1787692532.997772:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+5:2362:x1874531108118656:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787692532.998163:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:2362:x1874531108118656:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 391us (704us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787692532.998171:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:0.0:1787692533.000955:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692533.001183:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108118912 00000100:00100000:1.0:1787692533.001207:0:14359:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108118912 00000100:00100000:1.0:1787692533.001315:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00100000:1.0:1787692533.001325:0:14359:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+29:14510:x1874531108118912:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787692533.001701:0:14359:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+30:14510:x1874531108118912:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 375us (753us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787692533.001709:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 9 00000100:00080000:0.0:1787692533.003055:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787692533.004236:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692533.004318:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108119168 00000100:00100000:3.0:1787692533.004327:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108119168 00000100:00100000:3.0:1787692533.004399:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:3.0:1787692533.004411:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+30:14510:x1874531108119168:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787692533.004515:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+30:14510:x1874531108119168:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 106us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692533.004523:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 48 00000100:00100000:3.0:1787692533.006778:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692533.006930:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108119296 00000100:00100000:2.0:1787692533.006940:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108119296 00000100:00100000:2.0:1787692533.006998:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:2.0:1787692533.007009:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+30:14510:x1874531108119296:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692533.007030:0:14358:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692533.007052:0:14358:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df94b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2775 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.007153:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df952 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.007167:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df952 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.007180:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df952 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787692533.007217:0:14358:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787692533.007238:0:14358:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df952 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.007264:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df94b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2775 expref: 32 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.007290:0:14358:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df952 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2775 expref: 31 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.007299:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ec94636500) 00010000:00010000:2.0:1787692533.007302:0:14358:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787692533.007306:0:14358:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a3200, rc 0) 00000100:00100000:2.0:1787692533.007363:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+31:14510:x1874531108119296:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 355us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692533.007371:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 49 00000100:00100000:0.0:1787692533.011034:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692533.011116:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108119424 00000100:00100000:2.0:1787692533.011126:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108119424 00000100:00100000:2.0:1787692533.011180:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:2.0:1787692533.011190:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+6:2362:x1874531108119424:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692533.011206:0:15039:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692533.011223:0:15039:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9054096/0x5d8b8560a09df959 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b277c expref: -99 pid: 15039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787692533.011249:0:15039:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8e05f4, blocks: 0x1 00010000:00010000:2.0:1787692533.011267:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=439s v=(0 0) 00010000:00010000:2.0:1787692533.011271:0:15039:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692533.011279:0:15039:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9054096/0x5d8b8560a09df959 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b277c expref: 7 pid: 15039 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.011298:0:15039:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9054096/0x5d8b8560a09df959 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b277c expref: 7 pid: 15039 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.011331:0:15039:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ec814a2600, rc 0) 00000100:00100000:2.0:1787692533.011405:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:2362:x1874531108119424:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 216us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692533.011413:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:0.0:1787692533.014235:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692533.014330:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108119680 00000100:00100000:2.0:1787692533.014340:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108119680 00000100:00100000:2.0:1787692533.014408:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:2.0:1787692533.014418:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+31:14510:x1874531108119680:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787692533.014520:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+31:14510:x1874531108119680:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 102us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692533.014528:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 50 00000100:00100000:3.0:1787692533.016691:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692533.016948:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108119808 00000100:00100000:2.0:1787692533.016958:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108119808 00000100:00100000:2.0:1787692533.017013:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:2.0:1787692533.017024:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+31:14510:x1874531108119808:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787692533.056653:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934606 is committed 00000001:00080000:1.0:1787692533.056679:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1787692533.056848:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1787692533.056857:0:5853:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:1.0:1787692533.056886:0:5853:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1787692533.057070:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+14:14510:x1874531108119808:12345-192.168.206.27@tcp:44:lhsmtool_posix.0 Request processed in 40042us (40382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692533.057077:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125925632:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787692533.057080:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 51 00000100:00100000:1.0:1787692533.057128:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692533.057419:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125925632 00000100:00100000:0.0:1787692533.057427:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125925632 00000100:00100000:0.0:1787692533.057488:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787692533.057499:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125925632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787692533.057704:0:15040:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787692533.057708:0:15040:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787692533.057710:0:15040:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787692533.057713:0:15040:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787692532 -> 1787692532 00002000:00010000:0.0:1787692533.057715:0:15040:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:3.0:1787692533.058578:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787692533.059557:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692533.059662:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874531125925632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2164us (2530us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787692533.059673:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787692533.059702:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108119936 00000100:00100000:0.0:1787692533.059708:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108119936 00000100:00100000:0.0:1787692533.059741:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:0.0:1787692533.059764:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:2361:x1874531108119936:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1787692533.059980:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff92ecaed7df80/2, rc 0, transno 8589934595 00000100:00100000:1.0:1787692533.059988:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125925632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787692533.060276:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:2361:x1874531108119936:12345-192.168.206.27@tcp:16:lhsmtool_posix.0 Request processed in 513us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692533.060284:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:3.0:1787692533.062449:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692533.062522:0:14358:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108120192 00000100:00100000:2.0:1787692533.062531:0:14358:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108120192 00000100:00100000:2.0:1787692533.062595:0:14358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 52 00000100:00100000:2.0:1787692533.062604:0:14358:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+14:14510:x1874531108120192:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787692533.062655:0:14358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692533.062681:0:14358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3200/0x5d8b8560a09df952 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2775 expref: 14 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.062721:0:14358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ec94636500) 00010000:00010000:2.0:1787692533.062726:0:14358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787692533.062768:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df960 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.062782:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df960 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.062802:0:14358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df960 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787692533.063021:0:14358:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081ff9c05 reply state 0000000016a96313 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df960 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692533.063030:0:14358:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787692533.063642:0:14358:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+15:14510:x1874531108120192:12345-192.168.206.27@tcp:36:lhsmtool_posix.0 Request processed in 1034us (1197us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787692533.063652:0:14358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 52 00010000:00010000:2.0:1787692533.065882:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df960 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.065898:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df960 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.065905:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df960 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.065911:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3600 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692533.065916:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df960 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.065938:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df960 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.065954:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ec94636500) 00010000:00010000:2.0:1787692533.065957:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692533.065962:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df960 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.065968:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3600/0x5d8b8560a09df960 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14358 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692533.066065:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692533.066132:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108120320 00000100:00100000:2.0:1787692533.066141:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108120320 00000100:00100000:2.0:1787692533.066199:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:2.0:1787692533.066208:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:14510:x1874531108120320:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787692533.066224:0:15042:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787692533.066241:0:15042:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df967 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x3ba32cbf121b2783 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.066268:0:15042:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9054096/0x5d8b8560a09df959 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b277c expref: 8 pid: 15039 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.066276:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692533.066280:0:15042:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692533.066284:0:15042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df967 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2783 expref: 8 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.066329:0:15042:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9054096/0x5d8b8560a09df959 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b277c expref: 8 pid: 15039 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.066344:0:15042:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9054096/0x5d8b8560a09df959 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b277c expref: 8 pid: 15039 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692533.066358:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15042:1874531125925760:192.168.206.27@tcp:104: 00000100:00100000:2.0:1787692533.066636:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ecb22aa000 going to sleep for 11 seconds 00000100:00100000:0.0:1787692533.072997:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692533.073122:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15042:1874531125925760:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692533.073154:0:15042:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df967 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2783 expref: 8 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.073175:0:15042:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92ecbc2e1e00, rc 0) 00000100:00100000:2.0:1787692533.073227:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d44c134-b57f-4e11-ae4b-9864d89ff88e+8:14510:x1874531108120320:12345-192.168.206.27@tcp:101:lhsmtool_posix.0 Request processed in 7019us (7463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692533.073235:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:3.0:1787692533.073437:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108120448 00000100:00100000:3.0:1787692533.073443:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108120448 00010000:00010000:3.0:1787692533.073475:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9054096/0x5d8b8560a09df959 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b277c expref: 8 pid: 15039 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692533.073509:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:3.0:1787692533.073518:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+8:2361:x1874531108120448:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787692533.073531:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787692533.073552:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9054096/0x5d8b8560a09df959 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b277c expref: 8 pid: 15039 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.073581:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9054096/0x5d8b8560a09df959 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b277c expref: 8 pid: 15039 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.073603:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9054096/0x5d8b8560a09df959 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b277c expref: 8 pid: 15039 timeout: 539 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.073615:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692533.073619:0:14341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692533.073626:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2783 expref: 7 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.073636:0:14341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2783 expref: 7 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.073668:0:14341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2783 expref: 7 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692533.073682:0:14341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14341:1874531125925888:192.168.206.27@tcp:105: 00000100:00100000:3.0:1787692533.073747:0:14341:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec904000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692533.076994:0:14341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:14341:1874531125925888:192.168.206.27@tcp:105: 00010000:00010000:3.0:1787692533.077018:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787692533.077070:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:2361:x1874531108120448:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 3552us (4081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692533.077097:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 13 00000100:00100000:1.0:1787692533.079482:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692533.079612:0:15039:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108120576 00000100:00100000:3.0:1787692533.079621:0:15039:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108120576 00000100:00100000:3.0:1787692533.079674:0:15039:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:3.0:1787692533.079684:0:15039:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:2361:x1874531108120576:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787692533.080131:0:15039:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787692533.080135:0:15039:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787692532 00002000:00010000:2.0:1787692533.080138:0:15039:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787692531 00002000:00010000:2.0:1787692533.080140:0:15039:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787692532 -> 1787692532 00002000:00010000:2.0:1787692533.080142:0:15039:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787692533.080204:0:15039:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+8:2361:x1874531108120576:12345-192.168.206.27@tcp:2:lhsmtool_posix.0 Request processed in 520us (729us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787692533.080228:0:15039:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:0.0:1787692533.082542:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692533.082643:0:15856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108120704 00000100:00100000:1.0:1787692533.082652:0:15856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108120704 00000100:00100000:1.0:1787692533.082709:0:15856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:1.0:1787692533.082721:0:15856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d44c134-b57f-4e11-ae4b-9864d89ff88e+8:2362:x1874531108120704:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787692533.082770:0:15856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.082798:0:15856:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2783 expref: 8 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.082859:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692533.082863:0:15856:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787692533.082868:0:15856:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.082903:0:15856:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2783 expref: 8 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.082918:0:15856:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2783 expref: 8 pid: 15042 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692533.082932:0:15856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15856:1874531125926016:192.168.206.27@tcp:104: 00000100:00100000:1.0:1787692533.083010:0:15856:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec87f49600 going to sleep for 11 seconds 00000100:00100000:0.0:1787692533.084926:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692533.085015:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108120832 00000100:00100000:2.0:1787692533.085023:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108120832 00010000:00010000:2.0:1787692533.085055:0:14342:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df967 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2783 expref: 9 pid: 15042 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692533.085091:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 14 00000100:00100000:2.0:1787692533.085099:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ec903b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+9:2363:x1874531108120832:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787692533.085111:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787692533.085131:0:14342:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df967 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2783 expref: 9 pid: 15042 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.085145:0:14342:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df967 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2783 expref: 9 pid: 15042 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.085166:0:14342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787692533.085171:0:14342:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787692533.085176:0:14342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.085186:0:14342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.085203:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787692533.085250:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+9:2363:x1874531108120832:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 151us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692533.085267:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 14 00010000:00010000:1.0:1787692533.086554:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df967 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2783 expref: 8 pid: 15042 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692533.086573:0:15856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15856:1874531125926016:192.168.206.27@tcp:104: 00010000:00010000:1.0:1787692533.086593:0:15856:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.086604:0:15856:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.086627:0:15856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.086654:0:15856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.086663:0:15856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.086671:0:15856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.086678:0:15856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692533.086681:0:15856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.086691:0:15856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.086705:0:15856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.086712:0:15856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df96e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692533.086865:0:15856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ec903b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:2362:x1874531108120704:12345-192.168.206.27@tcp:1:lhsmtool_posix.0 Request processed in 4146us (4331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692533.086874:0:15856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 16 00000100:00100000:0.0:1787692533.089571:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692533.089665:0:14357:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108121088 00000100:00100000:3.0:1787692533.089674:0:14357:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108121088 00000100:00100000:3.0:1787692533.089730:0:14357:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 53 00000100:00100000:3.0:1787692533.089740:0:14357:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+14:14510:x1874531108121088:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787692533.089870:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14400/0x5d8b8560a09df975 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.089885:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14400/0x5d8b8560a09df975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.089895:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14400/0x5d8b8560a09df975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.090127:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.090140:0:14357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df944 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b276e expref: 15 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.090146:0:14357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.090176:0:14357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df944 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b276e expref: 15 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.090195:0:14357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df944 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b276e expref: 15 pid: 14356 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692533.090208:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1874531125926144:192.168.206.27@tcp:104: 00000100:00100000:3.0:1787692533.090277:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec904000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787692533.095069:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692533.095207:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108121216 00000100:00100000:0.0:1787692533.095216:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108121216 00010000:00010000:0.0:1787692533.095252:0:14341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df944 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b276e expref: 16 pid: 14356 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692533.095295:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 15 00000100:00100000:0.0:1787692533.095305:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+16:2362:x1874531108121216:12345-192.168.206.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787692533.095320:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787692533.095327:0:14341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df944 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b276e expref: 16 pid: 14356 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692533.095339:0:14341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df944 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b276e expref: 16 pid: 14356 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692533.095371:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ec94636500) 00010000:00010000:0.0:1787692533.095376:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692533.095386:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692533.095417:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692533.095435:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787692533.095491:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+16:2362:x1874531108121216:12345-192.168.206.27@tcp:103:ldlm_bl.0 Request processed in 187us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692533.095498:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 15 00010000:00010000:2.0:1787692533.096636:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2a00/0x5d8b8560a09df944 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b276e expref: 15 pid: 14356 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692533.096657:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1874531125926144:192.168.206.27@tcp:104: 00010000:00010000:2.0:1787692533.096677:0:14357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.096686:0:14357:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.096691:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787692533.097082:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787692533.097231:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787692533.097280:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787692533.097384:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaed7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14357:1874531125926272:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787692533.097478:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692533.097515:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec880cb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787692533.097562:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125926272 00000100:00100000:1.0:1787692533.097568:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125926272 00000100:00100000:1.0:1787692533.097611:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787692533.097620:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14357:x1874531125926272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787692533.097690:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14357:x1874531125926272:12345-0@lo:1000:mdt00_001.0 Request processed in 70us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787692533.097697:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787692533.097735:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaed7d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14357:1874531125926272:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1787692533.099757:0:14357:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1787692533.099880:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14357:1874531125926400:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787692533.099934:0:14357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787692533.099965:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90905840 going to sleep for 11 seconds 00000100:00100000:2.0:1787692533.100010:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125926400 00000100:00100000:2.0:1787692533.100017:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125926400 00000100:00100000:2.0:1787692533.100058:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787692533.100067:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbc2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14357:x1874531125926400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787692533.100257:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbc2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14357:x1874531125926400:12345-0@lo:1000:mdt00_001.0 Request processed in 189us (321us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787692533.100264:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787692533.100293:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dd500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14357:1874531125926400:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1787692533.100326:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100336:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100354:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100368:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b14800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692533.100379:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100387:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100403:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ec94636500) 00010000:00010000:1.0:1787692533.100406:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787692533.100410:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100415:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14800/0x5d8b8560a09df97c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100443:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8d4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100449:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8d4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100454:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8d4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100459:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec814a3a00 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:1.0:1787692533.100462:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8d4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100468:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8d4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100476:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:1.0:1787692533.100478:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787692533.100491:0:14357:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df8db lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2752 expref: 18 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100502:0:14357:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df8db lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2752 expref: 18 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100509:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df8db lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2752 expref: 18 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.100534:0:14357:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a2800/0x5d8b8560a09df8db lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.27@tcp remote: 0x3ba32cbf121b2752 expref: 18 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692533.100544:0:14357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1874531125926528:192.168.206.27@tcp:105: 00000100:00100000:1.0:1787692533.100607:0:14357:0:(client.c:2715:ptlrpc_set_wait()) set ffff92ec90905840 going to sleep for 11 seconds 00000100:00100000:1.0:1787692533.106226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692533.106299:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108121344 00000100:00100000:0.0:1787692533.106306:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108121344 00000100:00100000:2.0:1787692533.106315:0:14357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14357:1874531125926528:192.168.206.27@tcp:105: 00010000:00010000:2.0:1787692533.106342:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8d4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106351:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec814a3a00/0x5d8b8560a09df8d4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692533.106358:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 10 00000100:00100000:0.0:1787692533.106368:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecbbd2c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+19:14509:x1874531108121344:12345-192.168.206.27@tcp:49:dd.0 00010000:00010000:2.0:1787692533.106379:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df983 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106392:0:14357:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df983 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106402:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df983 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106410:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df983 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106415:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df983 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106420:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df983 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106426:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1800 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692533.106429:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df983 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106436:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df983 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106445:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:2.0:1787692533.106459:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787692533.106463:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df983 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106468:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ecbc2e1800/0x5d8b8560a09df983 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106478:0:14357:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14400/0x5d8b8560a09df975 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106485:0:14357:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14400/0x5d8b8560a09df975 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692533.106487:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecbbd2c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+19:14509:x1874531108121344:12345-192.168.206.27@tcp:49:dd.0 Request processed in 121us (271us total) trans 0 rc 0/0 00010000:00010000:2.0:1787692533.106491:0:14357:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14400/0x5d8b8560a09df975 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692533.106494:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 10 00010000:00010000:2.0:1787692533.106496:0:14357:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b14400 already unused, calling callback (ffffffffc1f734f0) 00010000:00010000:2.0:1787692533.106498:0:14357:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14400/0x5d8b8560a09df975 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106504:0:14357:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14400/0x5d8b8560a09df975 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106512:0:14357:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff92ec94636800) 00010000:00010000:2.0:1787692533.106514:0:14357:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787692533.106517:0:14357:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14400/0x5d8b8560a09df975 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.106521:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec88b14400/0x5d8b8560a09df975 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14357 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692533.106705:0:14357:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+18:14510:x1874531108121088:12345-192.168.206.27@tcp:57:lhsmtool_posix.0 Request processed in 16966us (17142us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787692533.106724:0:14357:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 53 00000020:00080000:2.0:1787692533.106728:0:14357:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787692533.106898:0:14390:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787692533.106903:0:14390:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787692533.106947:0:14390:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787692533.106953:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787692533.112971:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:2.0:1787692533.113082:0:14360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108121600 00000100:00100000:2.0:1787692533.113091:0:14360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108121600 00000100:00100000:0.0:1787692533.113203:0:14360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 11 00000100:00100000:0.0:1787692533.113213:0:14360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+18:14510:x1874531108121600:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787692533.114074:0:14360:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787692533.114181:0:14360:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1787692533.114228:0:14360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df98a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692533.114245:0:14360:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df98a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692533.114264:0:14360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df98a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692533.114272:0:14360:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df98a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692533.114278:0:14360:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df98a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692533.114284:0:14360:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df98a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787692533.114354:0:14360:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787692533.114464:0:14360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d44c134-b57f-4e11-ae4b-9864d89ff88e+20:14510:x1874531108121600:12345-192.168.206.27@tcp:35:lhsmtool_posix.0 Request processed in 1250us (1499us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1787692533.114473:0:14360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 11 00000020:00080000:0.0:1787692533.114477:0:14360:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787692533.116146:0:14344:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787692533.116157:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df98a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.116167:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec8b35a600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692533.116171:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df98a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.116179:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df98a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.116199:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff92ec94636500) 00010000:00010000:2.0:1787692533.116203:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787692533.116206:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df98a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.116211:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92ec8b35a600/0x5d8b8560a09df98a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14360 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.116228:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692533.116230:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787692533.116232:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787692533.245388:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692533.245546:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108121728 00000100:00100000:1.0:1787692533.245556:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108121728 00000100:00100000:1.0:1787692533.245620:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:1.0:1787692533.245629:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+7:2363:x1874531108121728:12345-192.168.206.27@tcp:4:dd.0 00002000:00010000:1.0:1787692533.245674:0:15045:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a8e05f4, atime: 0x6a8e05f3, ctime: 0x6a8e05f4, blocks: 0x1 00010000:00010000:1.0:1787692533.245683:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df991 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.245698:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1787692533.245702:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692533.245708:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.245737:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787692533.268180:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692533.268271:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692533.268302:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692533.268316:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692533.268327:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:0.0:1787692533.268338:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:3.0:1787692533.270304:0:15046:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787692533.270325:0:15046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787692533.270550:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108121856 00000100:00100000:3.0:1787692533.270562:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108121856 00000100:00100000:3.0:1787692533.270624:0:15046:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787692533.270634:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108121984 00000100:00100000:3.0:1787692533.270638:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108121984 00000100:00100000:3.0:1787692533.270657:0:15046:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787692533.270665:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108122112 00000100:00100000:3.0:1787692533.270669:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108122112 00000100:00100000:1.0:1787692533.270686:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787692533.270687:0:15046:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787692533.270698:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108122240 00000100:00100000:3.0:1787692533.270702:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108122240 00000100:00100000:1.0:1787692533.270718:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108122368 00000100:00100000:3.0:1787692533.270725:0:15046:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787692533.270730:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108122368 00000100:00100000:3.0:1787692533.270735:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108122496 00000100:00100000:3.0:1787692533.270741:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108122496 00000100:00100000:0.0:1787692533.270936:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.27@tcp (source: 12345-192.168.206.27@tcp) 00000100:00100000:1.0:1787692533.271047:0:15047:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787692533.271056:0:15047:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1787692533.271064:0:16585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531108122624 00000100:00100000:2.0:1787692533.271071:0:16585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531108122624 00000100:00100000:2.0:1787692533.271114:0:16585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:2.0:1787692533.271125:0:16585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d44c134-b57f-4e11-ae4b-9864d89ff88e+15:2363:x1874531108121856:12345-192.168.206.27@tcp:4:dd.0 00010000:00010000:2.0:1787692533.271166:0:16585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df998 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.271183:0:16585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692533.271187:0:16585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692533.271193:0:16585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df998 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.271206:0:16585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df998 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692533.274501:0:16586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:2.0:1787692533.274530:0:16586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d44c134-b57f-4e11-ae4b-9864d89ff88e+16:2363:x1874531108121984:12345-192.168.206.27@tcp:4:dd.0 00010000:00010000:2.0:1787692533.274586:0:16586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df99f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.274609:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692533.274614:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692533.274623:0:16586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df99f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.274640:0:16586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df99f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787692533.394459:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:3.0:1787692533.394526:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:3.0:1787692533.394546:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:2.0:1787692533.400374:0:15045:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1787692533.400388:0:15045:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1787692533.400484:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.400499:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.400509:0:15045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.400517:0:15045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88165200 already unused, calling callback (ffffffffc1534230) 00010000:00010000:2.0:1787692533.400522:0:15045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.400542:0:15045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df991 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.400566:0:15045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df991 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.400574:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d32cf265/0x5d8b8560a09df991 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787692533.400708:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf1c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+18:2363:x1874531108121728:12345-192.168.206.27@tcp:4:dd.0 Request processed in 155072us (155321us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787692533.400720:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 0 00000100:00100000:2.0:1787692533.400776:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:2.0:1787692533.400803:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+17:2363:x1874531108122112:12345-192.168.206.27@tcp:4:dd.0 00010000:00010000:2.0:1787692533.400916:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df9a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.400929:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692533.400935:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787692533.400943:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df9a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787692533.400957:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df9a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787692533.477296:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1787692533.477328:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:1.0:1787692533.478147:0:16586:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1787692533.478157:0:16586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:1.0:1787692533.478177:0:16586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df99f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.478193:0:16586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df99f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.478203:0:16586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df99f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.478211:0:16586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e0c00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692533.478217:0:16586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df99f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.478228:0:16586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df99f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.478276:0:16586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df99f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.478285:0:16586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f1a9be1/0x5d8b8560a09df99f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692533.479545:0:16586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d44c134-b57f-4e11-ae4b-9864d89ff88e+15:2363:x1874531108121984:12345-192.168.206.27@tcp:4:dd.0 Request processed in 205011us (211257us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787692533.479562:0:16586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 2 00000100:00100000:1.0:1787692533.479610:0:16586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:1.0:1787692533.479625:0:16586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d44c134-b57f-4e11-ae4b-9864d89ff88e+14:2363:x1874531108122240:12345-192.168.206.27@tcp:4:dd.0 00010000:00010000:1.0:1787692533.479671:0:16586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010df9d3b/0x5d8b8560a09df9ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.479690:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692533.479695:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692533.479702:0:16586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010df9d3b/0x5d8b8560a09df9ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.479718:0:16586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010df9d3b/0x5d8b8560a09df9ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787692533.480733:0:16585:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1787692533.487591:0:16585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df998 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.487638:0:16585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df998 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.487648:0:16585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.487656:0:16585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1800 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692533.487662:0:16585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df998 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.487674:0:16585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df998 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.487704:0:16585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df998 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.487712:0:16585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df998 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692533.487860:0:16585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d44c134-b57f-4e11-ae4b-9864d89ff88e+14:2363:x1874531108121856:12345-192.168.206.27@tcp:4:dd.0 Request processed in 216729us (219682us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787692533.487872:0:16585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 1 00000100:00100000:3.0:1787692533.487912:0:16585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 5 00000100:00100000:3.0:1787692533.487927:0:16585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d44c134-b57f-4e11-ae4b-9864d89ff88e+13:2363:x1874531108122496:12345-192.168.206.27@tcp:4:dd.0 00010000:00010000:3.0:1787692533.487970:0:16585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e24961/0x5d8b8560a09df9b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.487991:0:16585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692533.487996:0:16585:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692533.488005:0:16585:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e24961/0x5d8b8560a09df9b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.488020:0:16585:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2e24961/0x5d8b8560a09df9b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.509850:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787692533.535272:0:15045:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7340032 00010000:00010000:1.0:1787692533.535299:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df9a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.535334:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df9a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.535345:0:15045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df9a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.535410:0:15045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1e00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692533.535416:0:15045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df9a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.535427:0:15045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df9a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.535452:0:15045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df9a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.535461:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a80887f/0x5d8b8560a09df9a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692533.535609:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+17:2363:x1874531108122112:12345-192.168.206.27@tcp:4:dd.0 Request processed in 134816us (267298us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787692533.535620:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 3 00000100:00100000:1.0:1787692533.535662:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 6 00000100:00100000:1.0:1787692533.535677:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+16:2363:x1874531108122368:12345-192.168.206.27@tcp:4:dd.0 00010000:00010000:1.0:1787692533.535719:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df9bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.535741:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692533.535746:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787692533.535770:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df9bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.535794:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df9bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787692533.535994:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:0.0:1787692533.582377:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1787692533.584256:0:16586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:3.0:1787692533.584286:0:16586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010df9d3b/0x5d8b8560a09df9ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.584302:0:16586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010df9d3b/0x5d8b8560a09df9ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.584312:0:16586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010df9d3b/0x5d8b8560a09df9ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.584320:0:16586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88164400 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692533.584326:0:16586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010df9d3b/0x5d8b8560a09df9ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.584336:0:16586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010df9d3b/0x5d8b8560a09df9ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.584362:0:16586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010df9d3b/0x5d8b8560a09df9ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.584385:0:16586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010df9d3b/0x5d8b8560a09df9ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692533.584513:0:16586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d44c134-b57f-4e11-ae4b-9864d89ff88e+12:2363:x1874531108122240:12345-192.168.206.27@tcp:4:dd.0 Request processed in 104886us (316187us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1787692533.584524:0:16586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 4 00000100:00100000:3.0:1787692533.584568:0:16586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:3.0:1787692533.584584:0:16586:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d44c134-b57f-4e11-ae4b-9864d89ff88e+11:2363:x1874531108122624:12345-192.168.206.27@tcp:4:dd.0 00010000:00010000:3.0:1787692533.584626:0:16586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8cd28b5/0x5d8b8560a09df9c2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.584640:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692533.584645:0:16586:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787692533.584653:0:16586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8cd28b5/0x5d8b8560a09df9c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.584666:0:16586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8cd28b5/0x5d8b8560a09df9c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.585935:0:16585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e24961/0x5d8b8560a09df9b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.585955:0:16585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e24961/0x5d8b8560a09df9b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.585963:0:16585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2e24961/0x5d8b8560a09df9b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.585970:0:16585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b14c00 already unused, calling callback (ffffffffc1534230) 00010000:00010000:1.0:1787692533.585976:0:16585:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e24961/0x5d8b8560a09df9b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.585985:0:16585:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e24961/0x5d8b8560a09df9b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.586002:0:16585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2e24961/0x5d8b8560a09df9b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787692533.586025:0:16585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e24961/0x5d8b8560a09df9b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787692533.586101:0:16585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d44c134-b57f-4e11-ae4b-9864d89ff88e+11:2363:x1874531108122496:12345-192.168.206.27@tcp:4:dd.0 Request processed in 98174us (317755us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787692533.586110:0:16585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 5 00000001:00080000:0.0:1787692533.628835:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1787692533.628932:0:15045:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:3.0:1787692533.628955:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df9bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.628975:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df9bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.629009:0:15045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df9bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.629018:0:15045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ecbc2e1800 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692533.629023:0:15045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df9bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.629035:0:15045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df9bb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.629060:0:15045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df9bb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.629074:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000352565cc/0x5d8b8560a09df9bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692533.629196:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d44c134-b57f-4e11-ae4b-9864d89ff88e+9:2363:x1874531108122368:12345-192.168.206.27@tcp:4:dd.0 Request processed in 93516us (360858us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787692533.629208:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 6 00000001:00080000:1.0:1787692533.669510:0:7630:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:3.0:1787692533.669898:0:16586:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1787692533.669918:0:16586:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8cd28b5/0x5d8b8560a09df9c2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.669932:0:16586:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8cd28b5/0x5d8b8560a09df9c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.669960:0:16586:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8cd28b5/0x5d8b8560a09df9c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.669968:0:16586:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92ec88b15600 already unused, calling callback (ffffffffc1534230) 00010000:00010000:3.0:1787692533.669973:0:16586:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8cd28b5/0x5d8b8560a09df9c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.669983:0:16586:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8cd28b5/0x5d8b8560a09df9c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.670007:0:16586:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8cd28b5/0x5d8b8560a09df9c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787692533.670015:0:16586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8cd28b5/0x5d8b8560a09df9c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787692533.670134:0:16586:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d44c134-b57f-4e11-ae4b-9864d89ff88e+5:2363:x1874531108122624:12345-192.168.206.27@tcp:4:dd.0 Request processed in 85550us (401773us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787692533.670146:0:16586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.27@tcp, seq: 7 00000100:00100000:0.0:1787692534.081136:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787692534.081149:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787692534.081167:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125926784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787692534.081196:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125926656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787692534.081410:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125927168:0@lo:400:kworker.0 00000100:00100000:2.0:1787692534.081503:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874531125927296:0@lo:400:kworker.0 00000100:00100000:3.0:1787692534.082852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692534.082955:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25c21df9-20cc-4624-87d0-9b55ad554e5c:3305:1874531125926912:0@lo:400:kworker.0 00000100:00100000:3.0:1787692534.083070:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692534.083101:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874531125927424:0@lo:400:kworker.0 00000100:00100000:3.0:1787692534.083150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692534.083203:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125926656 00000100:00100000:3.0:1787692534.083214:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125926656 00000100:00100000:3.0:1787692534.083279:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787692534.083290:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125926656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787692534.083323:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:3.0:1787692534.083378:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874531125926656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692534.083387:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787692534.083501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692534.083528:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92ecbc2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125927040:0@lo:400:kworker.0 00000100:00100000:0.0:1787692534.083565:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692534.083598:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff92eca649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874531125927552:0@lo:400:kworker.0 00000100:00100000:0.0:1787692534.083628:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787692534.083665:0:15040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125927040 00000100:00100000:0.0:1787692534.083670:0:15040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125927040 00000100:00100000:0.0:1787692534.083721:0:15040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787692534.083730:0:15040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125927040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692534.083740:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125926784 00000100:00100000:3.0:1787692534.083746:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125926784 00000100:00100000:3.0:1787692534.083768:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787692534.083775:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874531125926784:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787692534.083778:0:15040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1874531125927040:12345-0@lo:400:kworker.0 Request processed in 49us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692534.083801:0:15040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1787692534.083839:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787692534.083885:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125927040:0@lo:400:kworker.0 00000100:00100000:0.0:1787692534.083937:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125927424 00000100:00100000:0.0:1787692534.083941:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125927424 00000100:00100000:0.0:1787692534.083973:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125927552 00000100:00100000:0.0:1787692534.083976:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125927552 00000100:00100000:0.0:1787692534.083991:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787692534.083998:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecb5330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874531125927424:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1787692534.084011:0:15043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787692534.084037:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecb5330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874531125927424:12345-0@lo:400:kworker.0 Request processed in 39us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1787692534.084045:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787692534.084064:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787692534.084065:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf6f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874531125926784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 287us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692534.084073:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787692534.084086:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaf683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874531125927552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692534.084099:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125926912 00000100:00100000:3.0:1787692534.084105:0:14351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125926912 00000100:00100000:0.0:1787692534.084120:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaf683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874531125927552:12345-0@lo:400:kworker.0 Request processed in 36us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692534.084136:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787692534.084141:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787692534.084146:0:14351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eb84d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:3305:x1874531125926912:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787692534.084162:0:14352:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787692534.084184:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874531125927552:0@lo:400:kworker.0 00000100:00100000:3.0:1787692534.084191:0:14351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eb84d89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:25c21df9-20cc-4624-87d0-9b55ad554e5c+19:3305:x1874531125926912:12345-0@lo:400:kworker.0 Request processed in 45us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692534.084200:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787692534.084211:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf6f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874531125926784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787692534.084262:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecbc2de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:25c21df9-20cc-4624-87d0-9b55ad554e5c:3305:1874531125926912:0@lo:400:kworker.0 00000100:00100000:3.0:1787692534.084276:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874531125927424:0@lo:400:kworker.0 00000100:00100000:3.0:1787692534.084296:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1787692534.084301:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff92ecaed7df80, transno 8589934595 00000004:00080000:3.0:1787692534.084321:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1787692534.084345:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92ecaf1c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874531125926656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787692534.084570:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787692534.084661:0:15042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125927168 00000100:00100000:3.0:1787692534.084666:0:15042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125927168 00000100:00100000:3.0:1787692534.084740:0:15042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787692534.084748:0:15042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92eca649d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125927168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787692534.084802:0:15042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92eca649d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874531125927168:12345-0@lo:400:kworker.0 Request processed in 55us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787692534.084809:0:15042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787692534.084864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787692534.085965:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874531125927296 00000100:00100000:2.0:1787692534.085979:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874531125927296 00000100:00100000:2.0:1787692534.086037:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787692534.086049:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff92ecaed7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874531125927296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787692534.086134:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff92ecaed7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874531125927296:12345-0@lo:400:kworker.0 Request processed in 89us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787692534.086142:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787692534.086205:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874531125927296:0@lo:400:kworker.0 00000100:00100000:0.0:1787692534.086768:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff92eca649d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874531125927168:0@lo:400:kworker.0 00010000:00010000:3.0:1787692534.529051:0:15864:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787692535.267691:0:16624:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1787692535.553161:0:14344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787692536.578149:0:14345:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29113 lines, 29113 kept, 0 dropped, 0 bad.